Special Education Symposium: Where AI Reads Lips and Tech Games Teach Math

A IIIT-Hyderabad curated Symposium on Special education saw the confluence of domain experts and research centers, brainstorming on the current landscape, its foundational challenges and gaps that could be plugged with implementable AI and tech innovations for the physically, visually, auditory and intellectually-challenged ecosystem.

The Symposium on Special Education, held on 12 June 2025 at IIIT Hyderabad hosted by the Centre for Visual Information Technology  and Raj Reddy Center for Technology and Society looked at critical challenges and key opportunities in the special education ecosystem. Two whitepapers and four technological solutions developed specifically for inclusive education were presented and a road map for future collaborations was drawn up.

Thought leaders, policymakers, technologists, innovators, field executives, teachers, therapists, NGO representatives, startup founders, corporate partners and researchers examined existing policies and grassroots programs at two interactive roundtable discussions and investigated gaps that could be plugged, using technology. Two renowned keynote speakers, Dr. Venu Govindaraju and Dr. Manohar Swaminathan, presented cutting edge solutions.

AI vs Human- Who has the Edge?
Dr. Venu Govindaraju, SUNY Distinguished Professor and VP of Research and Economic Development at New York’s University of Buffalo presented the keynote address on “AI or Human, Who has the Edge?” on the rapidly developing field of AI and ML, with simple everyday examples. He explained the wherewithal of “Narrow AI”; use cases like how AI outperforms your postman in reading postal address on envelopes.  GenAI solutions presented included contextually sensitive flash cards for Speech Pathology Therapists, real-time storyboarding for narrative learning, and virtual mirrors – a speech development tool to teach correct lip movements using deep-fake technology for good.

Analytical skills learnt through Play
Dr. Manohar Swaminathan, a Senior Principal Researcher at Microsoft Research India spoke about “Lucid Design for Accessibility in the Global South”. It explored solution design and showcased how mathematical and reasoning skills typically imparted by classroom curriculum, could be effectively learnt by visually impaired children, through fun games and play scenarios, with tactile card and board games and evaluated through game play observations.

Roundtables evaluate the current ecosystem
Two roundtable discussions deconstructed the present state of special education; from identification of specially-abled children to subsequent interventions, and currently available support structures and assistive technology solutions.

The discussion on early Identification of Learning Disabilities and support processes looked at three key intervention areas; Strategies and effectiveness of existing support structures, support systems of families and educators and currently available resources, especially accessibility of assistive technological solutions.

The second roundtable focused on technological innovations and their integration into special education programs. Key points discussed were Sign Language Generation and use of Advanced AI systems for creating contextually appropriate sign language, Automated Speech Evaluation using technology for speech disorders, a comprehensive review of current assistive technologies and an exploration of future Innovation Opportunities by identifying gaps and potential breakthrough areas.

Showcase of customized tech innovations
Technological innovations highlighted the practical applications of cutting-edge research, developed at IIIT Hyderabad Centers and by participating organizations.

Language Technologies Research Center (LTRC) Innovations
IIIT Hyderabad’s LTRC presented a comprehensive suite including Speech-to-Speech translation, Prosody-incorporated Text-to-Speech for enhanced language learning, and automated speech disorder detection. Two Spoken English apps that drew attention were Ucchar e-Sudharak, an automatic English pronunciation corrector designed for school-going children with teacher-in-the-loop feedback and Vyakaran e-Shikshak, an automatic English grammar evaluator in oral communication.

Center for Visual Information Technology (CVIT) Solutions
Three tech innovations presented by CVIT researchers for the visually impaired included an AI Assistant with a hands-free, voice-based low-latency system providing contextually aware environmental information through audio responses, AAVAZ – real-time synthetic speech generation based on speaker lip movement analysis, and a specialized audio book platform with book-to-audio generation and multi-lingual support. LipMOOC is a modular synthetic Massive Open Online Course to teach lip-reading using AI-generated face videos. CVIT researcher have designed scalable frameworks with Q&A capability in sign language, a co-articulated gloss-to-sign dictionary and diffusion-based interpolation for contextually appropriate fluid sign language generation as well as a StethoSpeech, a clinical stethoscope attached to skin for innovative speech generation.

Exo-suit and other tailored technology solutions
The Exo-Suit is a lightweight, customizable lower body wearable exoskeleton for rehabilitation movements with integrated safety protocols. For children with intellectual and developmental disabilities, the Schooling Landscape is a comprehensive platform designed to inform, connect, and empower families of special needs children. Akhar Indic Word Processor is a specialized text processing solution for Braille conversion in Indian languages.

Building a collaborative road map
Organisation Partnership expansion possibilities shortlisted were; Child Apperception Test (CAT) Integration with existing field partner and choice foundation, addition of anemia screening image collection to ongoing community health drives with choice foundation, additional data collection for the current HTP project and explore possibilities with Ananya early intervention clinic.

Academic Enhancements will look at a broader list of special education challenges and technology solutions to be built into the “Design for Social Innovation” course with project assignments focused on developing innovative solutions.

Technology Transfer connections will focus on facilitation between interested organizations and Prof. Chiranjeevi’s research team, follow-ups on sign language generation solutions in Ashray Akruti’s programs with its founder, IIITH and Qualcomm as involved partners and a pilot plan for testing sign language technologies in real educational settings.

The symposium was a big step in understanding how stakeholders including research institutions can partner with NGOs, technology companies, and advocacy organizations to build impactful solutions to real-world challenges in inclusive education. The two Whitepapers and collaborations will catalyze meaningful advancement in special education.

Leave a Reply

Your email address will not be published. Required fields are marked *

Next post