Unfolding

Unfolding is an improvised audio visual performance featuring Satoshi Takeishi and Matt Roberts. Takeishi performs with a prepared hammer dulcimer to create a mysterious and alluring soundscape, while Roberts accompanies Takeishi’s musical improvisations with real-time animation and video projection.

img_3240

forweb

Satoshi Takeishi, drummer, percussionist, and arranger is a native of Mito, Japan. His art explores multi-cultural, electronics and improvisational music with musicians and composers from around the world. Takeishi has appeared on over 75 recordings including those by Latin giants Nestor Torres, Ray Barretto, Hector Martignon and Eliane Elias (in the film, “Calle 54”). He has also performed with Laszlo Gardony, Shoko Nagai, Dave Liebman, Badal Roy, Erik Friedlander, Cantor, Sasha Argov, Colombian saxophonist Antonio Arnedo, Paul Winter, Antony Braxton, Theo Bleckmann/Ben Monder, Joel Harrison and Rob Brown.

Matt Roberts is a new media artist specializing in locative media, physical computing, augmented reality, and real-time video performance. His work has been featured internationally and nationally, including shows in Taiwan, Brazil, Canada, Argentina, Italy, Mexico and nationally in New York, San Francisco, Miami, and Chicago. He was awarded the Transitio Award by the International Transitio_MX Festival in Mexico City, and his work has been reviewed in New York Times, Wall Street Journal, and Miami Herald. Roberts received his MFA from the University of Illinois at Chicago, and is currently an Associate Professor of Digital Art at Stetson University, DeLand, Florida.

The Strangers

Burdened by history and our own expectations, art can become settled in space/place. The Strangers invites Orlando Museum of Art visitors to re-meet some familiar OMA holdings. Museum-goers are invited to download the free Layar app on their smartphones and through brief augmented reality encounters get to unknow the collection.

Dream Garden

 

Description:
Dream Garden is a site-specific project to gather, graft and nurture a city’s dreams.   Each time a city dweller texts a 7-word dream (a poetic form moving private experience into public space), that dream automatically joins others both in a “garden” (a designated physical location in the city) and online at inthedreamgarden.com.   The project shows how how some community resources– like citizens’ dreams — can inhabit and expand a space without wounding it, colonizing it or wasting natural resources.  As a political space, it’s urban renewal and greening without displacement.  As a philosophical space it suggests that dreaming together may change a city and even a country.  As a community garden it suggests that our dreams aren’t wasted—they are growable, transplantable, and in the poetic space of the project, both virtual and real.

How it works:
This project uses Layar, a free augmented reality application for mobile devices. Participants can download the Layar app and see their texted dream joined with others in site-specific locations. The international project is designed to adapt to any urban space.

This is a collaborative project with poet Terri Witek and software developer Michael Branton. For more information about the project visit inthedreamgarden.com

Unknown Meetings

um01

Unknown Meetings is a site-specific augmented reality project that takes as its premise the awkward and surreal encounters that daily occur on commutes. Designed by new media artist Matt Roberts and poet Terri Witek for local transportation systems riders activate via smart phone both an “unknown” object moving over the actual landscape and an accompanying brief poetic audio file which considers such encounters.

These are activated whenever the train approaches a station. Commuters use the free Augmented Reality app Layar on their smart phones to see a floating image—usually an out-of-place object –and hear a brief accompanying text. Stations are nexuses of anxiety when we commute—is this our stop? By floating objects and words that offer still more unexpected juxtapositions, Roberts and Witek try to shift the anxiety of arrival into a consideration of moving “connections.”

FIRE DREAMS

Description:
This project takes as its premise that when we walk through cities, our bodies enter the dreams of other people who’ve walked there. New media artist Matt Roberts and poet Terri Witek map the city by floating  various “dreamers” over interesting metropolitan spaces. City wanderers then follow this walkable dream map via an augmented reality phone app. Along the way, they are offered chances  to see a dream, hear a dream, text a dream of their own, send a photo, and perform various other  transmittable acts. These become part of the living dream map of the city.

How it works:
This project uses Layar a free augmented reality application for mobile devices. Participants can download the Layar app and follow the Fire Dreams map, which is designed as an international project adaptable to any urban space.

Project Website:
http://thefiredreams.com

Waves


This artwork responds to the current size and timing of the waves of the closet ocean of its current location. Every half hour the most current data from the closet ocean buoy station is downloaded. Custom software uses the current wave height and dominant wave period data from the buoy and transforms that information into a low frequency sound wave. As the size and timing of the waves in the ocean change so does the frequency of the sound waves produced by the software. These sound waves shake a bowl of water sitting on top of a speaker. This shaking produces wave patterns in the bowl that are captured by a video camera modified by the software and projected onto a wall. As the waves in the ocean change size and frequency the waves in the bowl will also change. This results in continuous variations of the shapes and patterns that one sees and hears which also reflects the constant changing conditions of the ocean.

Waves can be shown in various forms, below are examples of works driven by real-time wave data

Wind

Wind is a continuation of my interest in visualization of real-time weather data. This work responds to real-time wind data from the National Weather Service to create a moving abstract image.

EMP: Electronic Mobile Performance



EMP: Electronic Mobile Performance is a collaborative, multimedia project involving faculty and students from Stetson University’s Digital Arts program. The group’s primary mission is to explore collaborative artistic production using new technologies and to find new ways of presenting art outside of traditional venues. EMP is directed and founded by Matt Roberts, Associate Professor of Digital Arts at Stetson University. http://electronicmobileperformance.com

An earlier incarnation of EMP was a group created and directed by Matt Roberts know as MPG: Mobile Performance Group. MPG presented a number of site-specific performances at festivals and conferences throughout the country, including ICMC: International Computer Music Conference, Conflux, and ISEA: Inter-Society for the Electronic Arts. For more information about MPG please see the archived site.

EVERY STEP

Every Step allows a participant to create a short experimental animation while they walk. Each participant is given an armband with a mounted camera and pedometer. The pedometer is mounted inside the armband and is connected to the camera. The camera is mounted on the armband and points towards the sky. The pedometer acts as a trigger for the camera and an image of whatever is above the participant is taken every time a step is made.
To create an animation the participant simply puts on the armband and takes a walk wherever he or she would like to go. When the participant returns from the walk the images are transferred from the camera’s memory and loaded into a custom software program. The software program uses the images to create a frame-by-frame animation and to create a soundtrack for the animation. When the program completes the animation, a DVD is made and given to the participant.

Every Step reviewed by We Make Money not Art “The techy work that really charmed me by its simplicity, poetry and melodies was Every Step.”

CYCLES FOR WANDERING

Cycles for wandering is a project that mixes a pleasurable bike ride, real-time image manipulation, locative media and user participation to create a short experimental video. To create a video a participant simply takes a five to ten minute bike ride. The bike is equipped with a GPS and video camera that records images and movements of the rider’s trip. A computer, mounted on the bike, uses the information gathered from the GPS to make decisions on how to manipulate the images taken by the camera. When the rider returns from the trip a DVD of the video made is created for them.

Recipient of  Transitio Award, Transitio_MX 2007, Mexico City, Mexico
Cycles for Wandering Featured in Wired
Cycles for Wandering Featured in New York Times and Wall Street Journal

TRANSFERS

Transfers is a project exploring real-time generation of art and user participation in a mobile environment. Transfers allows a passenger of a taxi to generate a unique piece of art by giving the taxi driver directions. As the taxi moves through the city the passenger will experience a real-time manipulation of live exterior video and audio taken from a camera and microphone mounted in the taxi. The taxi is also equipped with a GPS that feeds an onboard computer data such as speed and direction. This computer is running custom audio/video manipulation software and uses the GPS data to make decisions about how the live video/audio feed is manipulated and seen by the passenger. The manipulations of the live feed is displayed on two LCD screens and heard through the cars stereo system. As the user tells the driver where to go the passenger becomes both performer and viewer as they experience a unique piece of art generated by their decisions. The software also records this performance and at the end of the drive the passenger receives a CD with a QuickTime movie file of his or her recorded performance.

Supertudo, TVE Brasil, Rio de Janeiro 2007

CAUTION

This artwork responds to the current networked devices, such as cell phones and laptops, in its vicinity with sounds and imagery of the character Lemmy Caution from Jean-Luc Godard’s film Alphaville.  A computer running networking sniffing software monitors the area for wireless data such as bluetooth and wireless internet signals. When a new wireless device enters the vicinity the piece will respond by announcing the wireless device’s name and if it is considered to be a threat. This piece requires one Macintosh computer with wireless and bluetooth, custom software, video projector and sound speakers.

MPG: MOBILE PERFORMANCE GROUP


MPG: Mobile Performance Group is a collective of new media artists interested in finding new ways to present art outside of traditional venues. MPG disseminates their work by using mobile technologies, real-time video/audio, custom interactive devices, and other new technologies that allow artist to engage the public. The group has performed throughout the country and participated in several international new media festivals including Conflux, ICMC, NWEAMO and ISEA. MPG is part of classes taught, by faculty Matt Roberts (Founder and Creative Director of MPG) and Nathan Wolek (Music Director of MPG), at Stetson University’s Digital Arts Program. For more information please visit http://www.mobileperformancegroup.com

You can find more information about the group at

http://www.mobileperformancegroup.com
http://www.flickr.com/photos/mobileperformancegroup/
http://www.youtube.com/user/mobileperformance

DropBox- Alpha Beta Disco: Goddard Remix


DropBox “flattens” Godard’s film “Alphaville” (1965) into a static multimedia database containing every scene, line of dialogue, sound effect and orchestral score cue. These materials are organized according to character, location and formal qualities. A 45-minute real-time performance/remix is realized solely using this database.

DropBox’s live performance represents an alternate, spontaneously improvised, non-narrative interface to Godard’s original work reproduced as a film.

DropBox relies on a primary improvisational tool “the remix” while performing with software of their design. DropBox blends elements from the “Alphaville” database with an abstract formal logic, rather than pursuing a narrative drive. DropBox cuts and pastes, overlaps and overlays, compresses and expands, filters, re-sequences and links multimedia data into new musical/visual formations.

DropBox

Matt Roberts is a memebr of DropBox which is a performance collaborative organized in 2001. Using video and audio software instruments in real-time, the duo micromanages original and found material via loops, non-linear equations and other processes.

DropBox – Duct Tape


Using only Duct Tape as material, DropBox pulls, rips and stretches the  tape to create a real-time performance. Above is a document of a  performance for the SubTropics Festival at PS742 in Miami Florida 2003.

DropBox

Matt Roberts is a memebr of DropBox which is a performance collaborative organized in 2001. Using video and audio software instruments in real-time, the duo micromanages original and found material via loops, non-linear equations and other processes.

DropBox- The Soft Bits

Using only materials found in the “virtual” scenes from the Disney film “Tron” (1982), DropBox creates a multimedia database of 3D landscapes, animated characters and synthetic sounds. After organizing the database according to various formal characteristics, DropBox creates a new interface to the computer world of “Tron” via a real-time performance employing original software instruments. “The Soft Bits” stretches and expands the world of “Tron” into beams of colored light and staccato digital pulses–a meditation upon the primary language of our technology.
DropBox

Matt Roberts is a memebr of DropBox which is a performance collaborative organized in 2001. Using video and audio software instruments in real-time, the duo micromanages original and found material via loops, non-linear equations and other processes.

EVENTS

Using custom video and audio software instruments in real-time. Matt Roberts and Nathan Wolek present a meditation on the Florida Landscape, which is realized as an improvised new media performance.

events03 events01

events02 events04

A NEW MOVIE

conner

This application uses mouse movements to create a new edit of Bruce Conner’s “A Movie”(1958). “A New Movie” maps each x/y position of the users screen and assigns each position of the screen to an edit point of “A Movie”. The application watches and records the users mouse movement over a chosen period of time. When enough data has been collected the application will re-edit the original version of ”A Movie”. The user can then view the re-edited version, which keeps the original soundtrack in place but rearranges the visual track according to the users daily mouse movements.
For more information on Bruce Conner and “A Movie”

SOFTWARE

Download Application (Macintosh)

SCREEN SHOTS

screen_01

screen_02

CONNER TIMES TEN

First in a series of applications made in homage to Bruce Conner, “Conner Times Ten” is an application that creates new images using Bruce Conner’s film “Ten Second Film” as its source. Conner’s “Ten Second Film”, which was made for the 1965 New York Film Festival but never shown during the festival because it was believed to be too “risky”, was made from ten film strips each 24 frames long. Using only multiples of 10 and 24 the application “Conner Times Ten” randomly chooses a frame from Conner’s “Ten Second Film” and new images are made from this frame. These new images are never the same or repeated in the same sequence.

Software

Download the application (Macintosh Classic)

Movie

Software Screen Shots

ss14 ss11

LA MEDIA NARANJA PROJECT – Electronic Güiro

Electronic Güiro
This project converts a metal güiro, which is normally used as a percussive instrument, into a video instrument. The güiro is modified with an arduino to create a link between the instrument and a computer. Every rib on the güiro becomes a switch, when a rib is struck a signal is sent to advance a video clip one frame. A musician can play the instrument as it is normally played, however in this case the performer produces video as well as audio.

La Media Naranja Project

La Media Naranja Project converts traditional music instruments, used in the Americas, into audio/visual instruments. The instruments can be played as they are normally used; however they also control real-time video manipulation and playback.