AudioTouch
AudioTouch is an interactive multi-touch interface for computer music exploration and collaboration. The interface features audio based applications that make use of multiple users and simultaneous touch inputs on a single multi-touch screen. A natural user interface where users can interact through gestures and movements, while directly manipulating musical objects, is a key aspect of the design; the goal is to be able to interact with the technology (specifically music based) in a natural way. Users can load, exit, and move musical applications using gestures as well as have a multiple applications operate within the same work environment. The design is built into a table that hides all the hardware necessary for tracking multiple inputs as well as displaying visual feedback on the touch surface.
Currently, the AudioTouch OS consists of four main musical applications. MultiKey, the first application, is similar to a typical musical keyboard or piano. The application includes two polyphonic musical keyboards, one being a full octave, and the other being two octaves. Users can resize, zoom, and rotate a keyboard by using a two finger gesture.
The second application, MusicalSquares, consists of color coded squares that bounce around within a bounding box. As the squares come in contact with each other, they collide, play a musical note (based on their color), and then bounce off each other in opposite directions. A user can press on a square and make a throwing gesture which causes the square to be thrown in the motioned direction.
Audioshape sequencer, is a third applications that allows users to create musical loops. Squares can be moved around and connected. When the play button is pressed on a square it plays through the connected squares in sequence.
Lastly, Musical Wong, is a multitouch game similar to pong/hockey. When the ball hits the walls, different sounds are played.
Video of the applications on the multitouch table:
For information about the process of building the table and software, please see the blog posts to the right.
24 Responses to "AudioTouch"
May 12, 2008 at 10:21 pm
Hi Seth. Fantastic Work. I love the pong and the loop machines for more traditional making. THe throwing squares are look fantastic for ambient things.
Has there been any pedagogy developed for any of the instruments?
Nice to know that MIT doesn’t have all the good stuff.
June 6, 2008 at 1:26 am
help me no of the softwar is campatle with me computer for the miny one so help me!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
July 3, 2008 at 7:20 am
hey seth, check out the readers digest asia may 2008 version at page 13. .there some king of table there that is somewhat similar to yours used in a concert. .
July 3, 2008 at 8:07 am
Hi timominous,
Where can I see this? Is there a free source online?
You’re probably talking about the ‘reactable’ which was ussed in concert with Bjork.
[...] http://ssandler.wordpress.com/audiotouch/ full size: Screenshot of some of the applications [...]
[...] AudioTouch « AudioTouch is an interactive multi-touch interface for computer music exploration and collaboration. The interface features audio based applications that make use of multiple users and simultaneous touch inputs on a single multi-touch screen. A natural user interface where users can interact through gestures and movements, while directly manipulating musical objects, is a key aspect of the design; the goal is to be able to interact with the technology (specifically music based) in a natural way. Users can load, exit, and move musical applications using gestures as well as have a multiple applications operate within the same work environment. The design is built into a table that hides all the hardware necessary for tracking multiple inputs as well as displaying visual feedback on the touch surface. It currently consists of 4 main apps: [...]
November 1, 2008 at 2:45 pm
Hello seth,
i have not yet built my homemade multitouch controller but plan to shortly. I plan to use it for music. Your information looks very helpful. I was wondering if you had seen this application:
http://www.youtube.com/watch?v=AklKy2NDpqs
what would be the software issues involved in making a touchscreen control a harmonic keyboard layout such as this (especially for controlling midi)? Im afraid im not massively technically literate ; (
peace
al
November 2, 2008 at 4:10 am
al peters: Yeah I have seen that video. It’s great! I was planning on making an application like that eventually (but without the need for physical markers). Well, we have software @ nuigroup.com that sends out OSC messages. OSC is like the new MIDI. So basically it tells you what x/y you pressed and you can use that however you want.
You can find more information out over at nuigroup.com where we have a bunch people building hardware and writing applications just like what you posted.
November 7, 2008 at 8:50 am
Brilliant!
Have you connected the music with numbers or words?
Imagine hearing music attached to key words or numbers as you scan a document. Even better is the possibility of attaching custom music samples to words to echo Persona Behaviour.
I’ll ask one of my technical friends to look at your software.
For more on the Persona Behaviour concept go to http://www.scenario2.com or scenario2.wordpress.com.
Cheers and good luck!
Nick
November 10, 2008 at 11:09 pm
Hi Nick!
No I haven’t tried using words or numbers, but that would be a good addition. Yeah, please pass on my work to your friend and let me know how it goes.
Thanks,
-Seth
December 4, 2008 at 6:41 pm
Hey!
Your table looks awesome, what did you use to finish the wood? Is it some sort of lacquer or paint?
Keep up the good work!
December 17, 2008 at 8:29 pm
zerosignal: I used a black paint that I rolled on and a few gloss spray clear goats. I think it would of been better if I sprayed the paint on also.
February 4, 2009 at 11:31 am
Hi, I live in The Netherlands, and for me it’s difficult to make because the products for making a MTmini or a Audio Touch table. So I ask if you could contact me with the mail so maybe we can talk and buy.
March 4, 2009 at 8:36 pm
i was just wondering sort of how you made audio touch. i really want to make a nui os of my own. im not asking for source code or anything just wanting to know where you began, what languages you used, and what did you need to know to make it… that is without telling me whats in it. does that make sense? well im a bit tired after making a multi touch of my own. i want it running an operating system of my own… ones that made for multitouch not windows. it would be so rewarding for my code to be the only code running in the machine. any suggestions, your just as much a leader as han in the nui regard. thanks
[...] idea of interconnecting various existing interactive surface interfaces such as the reacTable or AudioTouch. The TUIO protocol has been implemented using OpenSound Control and is therefore usable on any [...]
[...] AudioTouch [...]
April 30, 2009 at 7:31 pm
Hey, post the documentation to the group when your done, OK? It would be a great to us.
Leave a Reply
About
I'm currently doing research and developing a Multi-user, Multi-touch musical interface. This blog space will serve as both a documentation of my own progress as well as an informational space for others to learn and peruse their own Multi-touch techniques and applications.
Want to build your own multitouch surface table? Go to NUI Group to find out how.
Donations
Affiliates
Aesthetic Goal
Original Concept
Final Result
Want to build your own multitouch surface table? Go to NUI Group to find out how.
Recent Comments
| Timominous on AudioTouch |
 | pIYUSH on Videos |
 | Chris on The Beta – tbeta –… |
| cerupcat on Finished Table |
 | Jerome on Finished Table |
 | Cerise on FAQ |
 | Joe on Finished Table |
 | kourindo on Downloads |
 | onlineeasyincome on MTmini – How To |
| How to Make a Cheap … on MTmini – How To | |
| DIY Multitouch Surfa… on AudioTouch | |
 | hi on MTmini – How To |
 | чyдoвлюблятcя on MTmini – How To |
| First experiences | … on MTmini – How To | |
| Hello! (Introduction… on MTmini – How To |
Current Viewers
March 17, 2008 at 10:23 pm
Keep up the great work! I linked the video to my Interactive Multimedia Technology blog.