The Dyadic Interaction Assistant

The Dyadic Interaction Assistant

The Dyadic Interaction Assistant

Contact

Members

The Dyadic Interaction Assistant, part of the larger Social Interaction Assistant research project, consists of a webcam on a pan-tilt mechanism used to track human faces, regardless of whether the person is directly facing the camera. Additionally, the video collected by the camera is analyzed in real-time to determine the curvature of a person's eyebrows, and whether or not a person's mouth is open or closed in every frame of video. These non-verbal interaction cues are then delivered to the interaction partner who is blind or visually impaired. Delivery is in the form of vibrotactile cues, presented using the VibroGlove, an assistive technology tool for communicating information through the sense of touch. By making visual non-verbal social interaction cues more accessible, we hope to enrich social interactions for people who are blind or visually impaired.

Members

Sreekar Krishna

Sreekar Krishna

Assistant Research Technologist

Dr. Sethuraman "Panch" Panchanathan

Dr. Sethuraman "Panch" Panchanathan

Executive Vice President, ASU Knowledge Enterprise; Chief Research and Innovation Officer; Director, Center for Cognitive Ubiquitous Computing (CUbiC); Foundation Chair in Computing and Informatics

Vineeth N Balasubramanian

Vineeth N Balasubramanian

Assistant Research Professor