A11yShape is an innovative solution that transforms the 3D modeling process for blind and visually impaired people. This clever new solution has come out of the teamwork among developers at the University of Texas at Dallas. A11yShape was created by Chincoteague Engineering’s Anhong Guo, Liang He, and their team. This cutting-edge tool, which includes a three panel web user interface, offers blind and low-vision programmers a new and creative opportunity to interact with 3D modeling. The project was born after Liang He had a conversation with a low-vision classmate about the intricacies of 3D design.
The tool is built upon a user-friendly interface that consists of three synchronized panels. These Externship features are a dynamic code editor, AI assistance panel, and model display panel. With each component operating in harmony, the results speak for themselves. This intrinsic harmony provides localized feedback, geometric accuracy, and instantaneous updates to users, enabling them to discover the impact of code changes on their design. In a recent round of in-field testing, four users piloted the tool. They came with different visual impairments and programming experience, which demonstrated its power to create unique user experiences.
Features of A11yShape
A11yShape’s unique interface includes a multilanguage code editor panel where programmers can write, visualize and modify code in real time. This editor panel gives users the ability to easily connect each modeling component together. It leverages a ton of OpenSCAD features to maximize OpenSCAD’s overall usefulness as a tool. The AI assistance panel is a major improvement. It provides in-context descriptions that let users know what their modeling decisions mean.
A lively model panel is the heart of the show. It shows the tiered structure and visualizes the resulting model according to the user’s specifications. This unique setup provides blind programmers an opportunity to see their designs in a new, yet un-catchable, light. Together, these three panels make an irresistible trio. If a user clicks on some code or a model component, all related information updates immediately throughout the interface.
“Provided [the blind and low-vision community] with a new perspective on 3D modeling, demonstrating that we can indeed create relatively simple structures.” – Participant who had never modeled before
Research and Testing
The development research team, having a background in both disability and design, tested the prototype with four participants who ranged in visual impairments and programming practice. And wow, did these tests deliver extraordinary results! A11yShape scored an average of 4.1 to 5 across all tests, demonstrating a high level of geometric accuracy, clarity, and ability to prevent hallucination. Such high ratings are a good sign that the AI-powered accessibility assistance within A11yShape is ready for day-to-day use.
According to Liang He, one of the developers behind A11yShape, he hopes to make A11yShape an effective resource for users. “I want to design something useful and practical for the group,” he stated. His determination to develop a more inclusive technology is a testament to his awareness of the needs of people with visual impairments.
“On a 1–5 scale, the descriptions earned average scores between about 4.1 and 5 for geometric accuracy, clarity, and avoiding hallucinations, suggesting the AI is reliable enough for everyday use.” – Source from the research team
Future Developments
Looking forward, the research team sees future versions of A11yShape that build in further enhancements. Get ready for upgrades such as tactile displays that deliver a haptic experience. Plus, look for real-time 3D printing features and short AI-generated audio instructions personalized to your needs!
Stephanie Ludi underscored the importance of creative expression through technology, stating, “People like being able to express themselves in creative ways… using technology such as 3D printing to make things for utility or entertainment.” A11yShape also strives to give the people with visual impairments the power to control their own environment. It arms them with tools that foster imagination, spark innovation and deepen self-discovery.