In many places around the world, learning disabilities and impairments often go undiagnosed due to a lack of resources and access to facilities that test for them. But when missed, learning disabilities or color blindness can oftentimes discourage children from participating and excelling in class–sometimes eroding self-confidence in the process, which in turn can lead to far-reaching difficulties later in life.

But technology can help bridge the divide in communities where traditional testing isn’t scalable or accessible to students—so when children’s multivitamin brand Pharmaton Kiddi wanted to impact kids’ lives through technology, MediaMonks’ innovation team sharpened their pencils and put their digital skills to the test. The result is an assessment designed to determine whether students may have one of the learning impairments mentioned above—all while they’re having fun by playing their way through an engaging, interactive digital picture book.

Called Kiddi World, the app takes users aged 9-12 on a journey through the charming World of Words, which is populated with living school supplies and rendered in a charming, painterly aesthetic. Our hero is a sharp, courageous pencil named Lapi in pursuit of Gomba, an irritable eraser whose rampage results in the erasure of parts of the world and words becoming jumbled together. Through a series of visual and language-based activities, kids must erase the prickly eraser’s influence on the world and set things right. The app shows what edtech can achieve through a hands-on approach that brings together data, UX expertise and best-in-class creative storytelling.

Reducing Testing Anxiety with Under-the-Hood Innovation

“Kiddi World fills an empty space where you can pre-diagnose the child,” says Geert Eichhorn, Innovation Director at MediaMonks. He cautions that it isn’t meant to replace a medical professional’s diagnosis of any impairment. “It functions as an indicator based on professional tests,” he says, prompting parents’ or teachers’ attention if a child is likely to have an impairment.

Through AI, the test can measure students’ legibility with precise accuracy—for example, how much a student’s writing extends outside the bounds of a line. “It’s a matter of determining a percentage of error that allows us to apply some simple rules,” says Luis Guajardo, Creative Technologist at MediaMonks, “to tell teachers to look further into it and check in with the child.”

And that’s a good point; while children can play through the test by themselves (guided by text and voiceover instructions that lead them through timed exercises), the app doesn’t signal a reduction in the teacher’s role. Instead, it gives teachers a tool they can use to help them understand how individual students process information differently. They can apply this knowledge to how they educate their students—like making a customized lesson plan or supplementary programs—to aid in these students’ learning.

With so much happening under the hood, children are free to enjoy the assessment without feeling the pressure and anxiety that comes with being tested. Instead, the experience is designed and built to emphasize a child’s unique journey exploring the world with Lapi.

One of the more interesting ways the app achieves this is through handwriting recognition, which aids in identifying dysgraphia automatically as students write. Many touch devices, like Apple’s iPad, natively offer handwriting recognition to translate users’ handwriting into print text. This feature is great for extracting meaning from handwriting, like if a user is jotting down notes. To detect atypical writing behavior from typical ones, MediaMonks took handwriting recognition a step further.

“We used an external tool that could measure stroke speed and density, helping us measure if a line was made fast or slow,” says Eichhorn. These variables are key for making a precise assessment for whether a student might have dysgraphia. “We employed a set of rules that identify aspects of dysgraphia that are particularly notorious and can be examined by the app,” says Guajardo.

In addition to native handwriting recognition, the team also had to disable spell check native to iOS apps. If a student’s spelling mistakes are corrected as they go, it would impact their score—an obvious, but easy to overlook, barrier to accuracy. “Instead, we use an API that determines if what a student has written is a real word, or close to a real word,” says Eichhorn.

Building Immersion Through Design

The tech under the hood is remarkable, but the designs on the surface of the experience are what bring Kiddi World to life. For every action, students write or draw something on the screen, adding to the sense of engagement as they make their mark—literally—on the story’s world. This is why the user’s avatar is a pencil: Lapi reflects the everyday tools that students use in class.

Narrative is ingrained into each of the challenges that kids must overcome in their journey through the World of Words. First, they’re tested on color blindness: Gomba has erased a path through the land, so readers have to draw it back by tracing a line that cuts through a pattern commonly used in tests to determine the type and intensity of color blindness that one might have. Users complete this challenge by drawing a series of segments of the path, which then come together like comic panels to create a full scene.

If a student is color blind and therefore can’t see one or more paths, they can simply skip that segment. This way, students aren’t penalized for something they can’t control, which is critical to how the assessment is designed and progresses. No matter how students respond or interact in any of the exercises, results aren’t telegraphed to them nor do they affect the narrative. Instead, results are saved in a report that’s delivered to the teacher upon each test’s completion.

Eichhorn notes that the narrative is constructed in a way that gives students a real sense of progress. “In the first chapter, students are working with Lapi to respond to what Gomba has already done,” he says. “In the middle, they’re about the same level as him, and in Chapter 3, they’re ahead of him and trying to thwart his plans.”

The flow (and lack of scoring interrupting the narrative) ensures students feel confident and empowered regardless of difficulties they face in the assessments—of which there are a variety. “A lot of testing is required for accuracy,” says Eichhorn. “We found that we needed maybe six times as much information than we originally imagined to come to a reliable and accurate result.”

Still, the team was able to deliver the necessary assortment of tests seamlessly integrated into an engaging narrative—a good test for partners who understand both tech, user experience and visual design. From responding to a direct regional need and offering a familiar and engaging narrative experience, Kiddi World shows that innovation doesn’t have to come at the cost of usability or accessibility. In fact, it can help us facilitate better accessibility to users who need it.

Tools like this can have a profound impact on education—not just by aiding students who might have one of the tested learning disabilities or color blindness, but by initiating more personalized educational plans. By providing measured feedback on how students process information, edtech like Kiddi World enable closer, one-to-one connections between students and teachers, helping them identify the best individualized approach to enhance a student’s learning.