Tactile/Haptic Computer Interaction Devices For the Blind

Current project:
Desktop Co-robotic Assistant for Information Access for Individuals Who Are Blind (S. Gill)

Overview picture

Current access to electronic content is limited to screen readers or Braille displays, which provide primarily sequential access to text only. This is particularly limiting given the dominance of graphical diagrams to convey information. Being able to skim a page for words relevant to the task at hand, is also important for equivalent effective access to text as sighted users. In addition, current access to create electronic content for individuals who are BVI is through keypad entry, whether using print character or Braille character entry. However, unlike users with vision, a user who is BVI is not able to simultaneously enter data and view the result. Finally, being able to show or be shown by others particular aspects of the content, whether by pointing or other physical means, is an important component when working collaboratively, teaching or being taught. The main goal of this grant is to provide a coherent haptic system that provides effective input and output of graphics and Braille on a full page through the same hand posture on the device.

Previous projects:
The Use of Virtual Textures and Multiple Fingers to Enhance the Understanding of Tactile Diagrams (D. Burch)

Burch, D. and Pawluk, D. (2011). Using Multiple Contacts with Texture-enhanced Graphics. 2011 IEEE World Haptics Conference.

The Perception of Virtual Textures Through a Haptic Multi-pin Display Device (P. Headley)

Headley, P.C. and Pawluk, D.T.V. (2011). Roughness Perception of Textures on a Haptic Matrix Display. 2011 IEEE World Haptics Conference.

Displaying Braille Labels with Graphics with a Tactile Mouse (V. Hribar, L. Deal)

Hribar, V., Deal, L. and Pawluk, D. (2012). Displaying Braille and Graphics with a Tactile Mouse. ACM Assets 2021, 351-352.