This workshop was organised and conducted by me (Elisa Rubegni) and Yaniv Steiner at the M.S. Technology-Enhanced Communication for Cultural Heritage.

A workshop focused on “computer vision” and pattern-recognition software to control on-screen emulation of everyday devices, where students will be able to prototype a physical interface. The interface, realized as a controller for devices or services, will use pattern-recognition for implementations of physical knobs and buttons. Just like the musical tool Reactable, which incorporates pattern-recognition to control sounds and audio effects, this workshop will be directed to create substitute interfaces for devices such as: TV, Radio and Audio devices; or for services like browsing Flickr’s photos, YouTube’s videos and I-tunes on local machines. Based on “Reactivision”, students will make use of a platform created by Nastypixel as a rapid prototyping tool. This tool enables students to swiftly mold interfaces for a wide variety of purposes. As open-source methods of development become a new standard, students will literally open up the makings of interfaces to expose their mechanisms of operation. Combining both physical and conceptual interface ideas, students will learn ways to rapid prototype their ideas in the future.

reactvision Instantsoup wiring Tuio and

The approach “learning by making” allows students to produce real hand-on prototypes and to learn how to design innovative pattern of interactions and user interfaces in context in which physical world and digital media are interconnected.


Fercu Michael
Yehia Amr
Aida Aidka
Keikha Mostafa
Hwang Yoon Nam
Stefania Lorenzi
Viviana D’Angelo
Shelley Mannion
Amalia Sabiescu
Matteo Agosti
Alberto Terragni
Ahmadi Navid