Tracking and Smart Textiles Environment (TASTE)
Combines Responsive User Body Suits (RUBS) and the
I have a strong interest in creating and using new interfaces for performance, especially those that capture gesture in some manner and provide performers and
audiences new emotional and musical experiences. The interfaces make use of visual tracking, accelerometers, pitch or volume detection, and other sensors, with Max/MSP or Processing being used
for software creation. The RUBS interface uses conductive and resistive fabrics, with the performer using conductive materials on the fingers to complete the circuits and trigger or scrub through samples.
The KiCASS system uses the Kinect-for-Windows with custom software to track the coordinates of 25 joints/body locations on multiple dancers. Examples of the systems can be seen on my video page. We are currently
refactoring the code to run on the Orbbec system and handle colour recognition.
Kinect-Controlled Artistic Sensing System (KiCASS)