Tangible Environment for SCRATCH
Current Project:
Tangible Programming Environment for Scratch; B. Goolsby PhD student, H.W. Kim, PhD)
Funding: 
NSF DRL
The main goal of this prior work was to develop a nonvisual interface for the Scratch programming language in order to enable BVI students to learn Scratch programming independently alongside their sighted peers. A critical component of the approach was to translate key aspects of Scratch that increased engagement and lowered hurdles to programming for sighted students to the haptic domain, which is accessible by all BVI students. To do so, it was necessary to consider the significant differences between how haptics and vision process information to avoid adding new barriers due to these differences. Visual design techniques for low vision were also used in tandem to ensure access for BVIs who may still use their residual vision, as well as sighted students. Components of the system were developed with stakeholder feedback, including two full design iterations for the main components of the system with objective user testing involving BVIs.
A pilot test involving BVI middle school and high school students using the complete system was performed through multiple offerings of a 2-day camp for BVI students at VCU. Each camp simulated a classroom setting with 1-2 BVI students. A hands-on learning curriculum, consisting of lecture notes, accessible multi-media support materials and accessible quizzes, was created for this purpose. A subset of the Scratch code blocks were used, including most of the blocks from the Motion and Control categories, as well as some code blocks from the Events, Operators and Sensing categories. Audio-visual data of student behavior, as well as an exit survey, was collected and analyzed using qualitative content analysis methods. Participating BVI students did use the system as expected and were enthusiastic about the camp. Improvements for subsequent design iterations were noted.
Publications for this work:
Assistive Technology, https://www.tandfonline.com/doi/abs/10.1080/10400435.2023.2213733
Sensors, https://www.mdpi.com/1424-8220/23/11/5159