AudioTouch
AudioTouch is an interactive multi-touch interface for computer music exploration and collaboration. The interface features audio based applications that make use of multiple users and simultaneous touch inputs on a single multi-touch screen. A natural user interface where users can interact through gestures and movements, while directly manipulating musical objects, is a key aspect of the design; the goal is to be able to interact with the technology (specifically music based) in a natural way. Users can load, exit, and move musical applications using gestures as well as have a multiple applications operate within the same work environment. The design is built into a table that hides all the hardware necessary for tracking multiple inputs as well as displaying visual feedback on the touch surface.
Currently, the AudioTouch OS consists of four main musical applications. MultiKey, the first application, is similar to a typical musical keyboard or piano. The application includes two polyphonic musical keyboards, one being a full octave, and the other being two octaves. Users can resize, zoom, and rotate a keyboard by using a two finger gesture.
The second application, MusicalSquares, consists of color coded squares that bounce around within a bounding box. As the squares come in contact with each other, they collide, play a musical note (based on their color), and then bounce off each other in opposite directions. A user can press on a square and make a throwing gesture which causes the square to be thrown in the motioned direction.
Audioshape sequencer, is a third applications that allows users to create musical loops. Squares can be moved around and connected. When the play button is pressed on a square it plays through the connected squares in sequence.
Lastly, Musical Wong, is a multitouch game similar to pong/hockey. When the ball hits the walls, different sounds are played.
Video of the applications on the multitouch table:
For information about the process of building the table and software, please search the hardware cetargory of this website.
Keep up the great work! I linked the video to my Interactive Multimedia Technology blog.
Thanks Lynn!
Looks sweet Seth!
keep up the good work….this is amazing….
Hi Seth. Fantastic Work. I love the pong and the loop machines for more traditional making. THe throwing squares are look fantastic for ambient things.
Has there been any pedagogy developed for any of the instruments?
Nice to know that MIT doesn’t have all the good stuff.
help me no of the softwar is campatle with me computer for the miny one so help me!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
hey seth, check out the readers digest asia may 2008 version at page 13. .there some king of table there that is somewhat similar to yours used in a concert. .
Hi timominous,
Where can I see this? Is there a free source online?
You’re probably talking about the ‘reactable’ which was ussed in concert with Bjork.
yeah. .that was the one. .
[...] http://ssandler.wordpress.com/audiotouch/ full size: Screenshot of some of the applications [...]
[...] AudioTouch « AudioTouch is an interactive multi-touch interface for computer music exploration and collaboration. The interface features audio based applications that make use of multiple users and simultaneous touch inputs on a single multi-touch screen. A natural user interface where users can interact through gestures and movements, while directly manipulating musical objects, is a key aspect of the design; the goal is to be able to interact with the technology (specifically music based) in a natural way. Users can load, exit, and move musical applications using gestures as well as have a multiple applications operate within the same work environment. The design is built into a table that hides all the hardware necessary for tracking multiple inputs as well as displaying visual feedback on the touch surface. It currently consists of 4 main apps: [...]
Hello seth,
i have not yet built my homemade multitouch controller but plan to shortly. I plan to use it for music. Your information looks very helpful. I was wondering if you had seen this application:
http://www.youtube.com/watch?v=AklKy2NDpqs
what would be the software issues involved in making a touchscreen control a harmonic keyboard layout such as this (especially for controlling midi)? Im afraid im not massively technically literate ; (
peace
al
al peters: Yeah I have seen that video. It’s great! I was planning on making an application like that eventually (but without the need for physical markers). Well, we have software @ nuigroup.com that sends out OSC messages. OSC is like the new MIDI. So basically it tells you what x/y you pressed and you can use that however you want.
You can find more information out over at nuigroup.com where we have a bunch people building hardware and writing applications just like what you posted.
Brilliant!
Have you connected the music with numbers or words?
Imagine hearing music attached to key words or numbers as you scan a document. Even better is the possibility of attaching custom music samples to words to echo Persona Behaviour.
I’ll ask one of my technical friends to look at your software.
For more on the Persona Behaviour concept go to http://www.scenario2.com or scenario2.wordpress.com.
Cheers and good luck!
Nick
[...] http://ssandler.wordpress.com/audiotouch/#comment-1020 [...]
Hi Nick!
No I haven’t tried using words or numbers, but that would be a good addition. Yeah, please pass on my work to your friend and let me know how it goes.
Thanks,
-Seth
Do you think You could get me a download of the whole suite
Hey!
Your table looks awesome, what did you use to finish the wood? Is it some sort of lacquer or paint?
Keep up the good work!
zerosignal: I used a black paint that I rolled on and a few gloss spray clear goats. I think it would of been better if I sprayed the paint on also.
Hi, I live in The Netherlands, and for me it’s difficult to make because the products for making a MTmini or a Audio Touch table. So I ask if you could contact me with the mail so maybe we can talk and buy.
i was just wondering sort of how you made audio touch. i really want to make a nui os of my own. im not asking for source code or anything just wanting to know where you began, what languages you used, and what did you need to know to make it… that is without telling me whats in it. does that make sense? well im a bit tired after making a multi touch of my own. i want it running an operating system of my own… ones that made for multitouch not windows. it would be so rewarding for my code to be the only code running in the machine. any suggestions, your just as much a leader as han in the nui regard. thanks
[...] idea of interconnecting various existing interactive surface interfaces such as the reacTable or AudioTouch. The TUIO protocol has been implemented using OpenSound Control and is therefore usable on any [...]
[...] AudioTouch [...]
Hey, post the documentation to the group when your done, OK? It would be a great to us.
[...] Sandler, creator of Audiotouch (shown in the picture above and embedded in the video below) and other multi-touch projects, will [...]
[...] fois la table construite, il ne vous reste plus qu’à installer l’excellent AudioTouch OS de Seth Sandler qui regroupe plusieurs applications tactiles [...]
[...] les gustó el modo en que está hecho el tutorial, les recomiendo que se pasen por la sección de Audiotouch OS que es la especialidad de este muchacho. Su creación nos ofrece una interfaz para poder reproducir [...]
Looks like an awesome product.. Will you be at winter namm.. I’m starting to look at technological products for my site and would like to check this out in person. Thanks for the article either way.
[...] AudioTouch – [...]
Leave your response! Your thoughts are welcome.
Subscribe
Follow Me On:
Tags
Projects
Original Concept
Final Result
Want to build your own multitouch surface table? Go to NUI Group to find out how.
Audiotouch
Recent Comments
Affiliates
Visit the NUI Group Community
Stats
Recent Posts
Most Commented
Most Viewed