Haptics in audio described movies

Publication Type:

Conference Paper

Authors:

L.N. Viswanathan, T. McDaniel, Krishna S, S. Panchanathan

Source:

IEEE International Symposium on Haptic Audio Visual Environments and Games (HAVE) (2010)

Abstract:

Similar to closed captioning for people who cannot hear, Audio Description (AD) in movies correspond to a secondary audio track describing events that are otherwise visually dominant. To aid people who are visually impaired or blind in understanding the happenings of a movie, the narrator describes the emotions, expressions, and actions presented in a movie scene, among many other details. A major drawback in AD is the necessity to comprehend an overloaded auditory channel. Also, the lack of time available between dialogues leaves certain information not described. By incorporating haptics with AD, we intend to employ a multi-modal approach in an attempt to make movies more accessible for people who are visually impaired. In this demonstration, participants will experience tactile cues for a) the relative position of two actors in a scene through our novel vibrotactile belt, and b) their facial expressions through our novel vibrotactile glove.

Authors

Lakshmie Narayan Viswanathan

Lakshmie Narayan Viswanathan

Masters Student Researcher

Dr. Troy L. McDaniel

Dr. Troy L. McDaniel

Assistant Professor, The Polytechnic School; Director, HAPT-X Laboratory; Director, Center for Cognitive Ubiquitous Computing (CUbiC); PI, NSF-NRT grant program, Citizen-Centered Smart Cities and Smart Living

Sreekar Krishna

Sreekar Krishna

Assistant Research Technologist

Dr. Sethuraman "Panch" Panchanathan

Dr. Sethuraman "Panch" Panchanathan

Director, National Science Foundation