Beyond the Screen: Decoding the First User Experience of ASD Educational Apps
Investigating the first user experience and accessibility of educational applications for autistic children
This paper presents a multi-method evaluation of four educational applications (ABC Autismo, Jade Autismo, OTO, and Aprendendo com Biel e seus amigos) designed for children with Autism Spectrum Disorder (ASD). Utilizing HCI methods, the study assesses both the first user experience (UX) and accessibility compliance using the GAIA guidelines, involving ten autistic children and their mothers in a naturalistic setting.
TL;DR
Is technology a bridge or a barrier for autistic learners? This study investigates four popular educational apps through the lens of ten autistic children and their mothers. While the apps are "easy to learn," the research uncovers a darker side: interface flaws that trigger stress and sensory overload. By combining real-world observation with accessibility inspections, the authors provide a roadmap for more empathetic HCI design in the neurodiversity space.
The "Development-Evaluation" Gap
We are currently in a "Gold Rush" of educational technology for Autism Spectrum Disorder (ASD). However, most papers focus on building new tools rather than validating existing ones. This study addresses a critical oversight: just because an app is "educational" doesn't mean it provides a positive User Experience (UX). For a child with ASD, a poorly timed sound effect or a confusing "drag-and-drop" requirement isn't just a minor UX glitch—it can be a trigger for severe emotional distress.
Methodology: A Dual-Lens Approach
The researchers didn't just stay in the lab. They went into the "natural environment" (the children's homes) to observe the First Experience of Use.
- Direct Observation: 10 children (Level 1 and 2 ASD) interacted with apps like ABC Autismo and Jade Autismo.
- Accessibility Inspection: Using the GAIA guide—a specialized set of 10 categories for ASD accessibility—experts audited the apps for visual noise, redundancy, and interaction patterns.

Figure 1: The multi-stage methodological workflow involving participants and specialists.
The Core Conflict: Ease of Use vs. Emotional Response
The findings present a fascinating paradox. As shown in the performance charts, most children found the apps easy to learn. However, "Easy to Learn" does not equal "Pleasant to Use."
Key Discoveries:
- The Frustration Trigger: Apps like Jade Autismo require a specific click-to-select sequence. Children accustomed to "drag-and-drop" became visibly irritated (screaming or physical reactions) when the app didn't respond to their intuitive gestures.
- The Attention Tax: Children with Level 2 ASD (moderate) showed a significant drop in attention, often distracted by "visual noise"—colorful icons or animations that had nothing to do with the educational task.
- Sensory Triggers: One app used a "register bell" sound for success. For a neurotypical child, this is a reward; for an autistic child with auditory hypersensitivity, it was reported as potentially "perturbing."

Figure 2: Analysis of mood changes and attention spans during app usage.
The GAIA Inspection: Where Apps Fail
The accessibility audit using the GAIA framework highlighted three major "pain points":
- G3 - Engagement: Initial screens were often too "busy," causing children to click on logos or background elements instead of the "Start" button.
- G4 - Redundant Representations: Most apps failed to provide audio descriptions for visual icons. If a child didn't recognize a symbol, there was no "voice-over" to help them.
- G10 - Touch Interaction: The lack of flexibility in touch-input (forcing a click vs. a drag) was a primary source of user error.
Critical Insight & Future Outlook
The most profound takeaway from this study is that HCI for ASD must be adaptive. A "one-size-fits-all" interface fails because the spectrum of ASD is too broad.
Recommendations for Developers:
- Simplify Visuals: Use the "less is more" principle to prevent cognitive overload.
- Flexible Interaction: Allow multiple ways to solve a puzzle (dragging or clicking).
- Positive Reinforcement: Ensure rewards are sensory-friendly (soft tones instead of high-pitched pings).
Conclusion
This paper serves as a sober reminder that technology's value is defined by the user's emotional state, not just their ability to click a button. By integrating mothers as mediators and using specialized accessibility guides like GAIA, the research highlights a path toward software that doesn't just "teach" but actually "supports" the neurodivergent mind.
Future Work: We need longitudinal studies to see if these "first experiences" improve over time as the child develops a mental model of the interface, or if the initial frustration leads to long-term tech-aversion.
