The Dyadic Interaction Assistant
The Dyadic Interaction Assistant, part of the larger Social Interaction Assistant research project, consists of a webcam on a pan-tilt mechanism used to track human faces, regardless of whether the person is directly facing the camera. Additionally, the video collected by the camera is analyzed in real-time to determine the curvature of a person's eyebrows, and whether or not a person's mouth is open or closed in every frame of video. These non-verbal interaction cues are then delivered to the interaction partner who is blind or visually impaired. Delivery is in the form of vibrotactile cues, presented using the VibroGlove, an assistive technology tool for communicating information through the sense of touch. By making visual non-verbal social interaction cues more accessible, we hope to enrich social interactions for people who are blind or visually impaired.