Maowei Yu

portfolio > speechfighter (selected in Pratt Show, Computer Arts 2009 Graduate Showcase, Adobe Design Achievement Awards final round now!)

Documentation

[flashvideo filename="video/speechfighter.flv" /]

Software/program

Max5, JavaScript, Flash, Photoshop, Illustrator, MacSpeech Dictate

Abstract

SpeechFighter is an interactive installation and performance which visualizes the mutual effects of interpersonal communication between two users. It analyzes users’ speech and voices which appear as texts on a screen. Texts of both users interact with each other and the users themselves. Negative words add creepy images to the projection, and positive words show pleasant images.

As a former advertising student, I am curious about the power of dyadic communication. Sometimes a word from a person can easily change our mind. Speaking has its quality. We have to speak in real time and often we can’t prepare what we are going to say. Truth or lie, rude or polite, these all depend on the moment right before we speak the first word. I think this feature makes speaking powerful. A voice in the air will disappear, but the meaning of what we said will stay and interact with the audience.

Technical detail / Installation drawing

In order to enable users to fight each other with their speech, SpeechFighter needs two systems running together, one for each user.

Hanging from the ceiling are two projectors and infrared cameras facing the same position where the users can stand in front. The cameras use a double thickness of exposed color negative film as a filter to block visible light. The projection screen is illuminated by invisible infrared light  from the rear. With this setting, the projection screen becomes a light box and the participants in front of the screen are seen as dark shadows by the cameras.

The users have microphones  which connect with the computers to conjure words that are spelled out and move across the screen. They can move their bodies to touch the words to generate different images.