Virtual Booth

Over 430 million people worldwide have disabling hearing loss, and Malaysia's deaf community faces daily barriers in education, social interaction, and personal safety. Existing apps address only one need (translating, learning, or captioning), forcing users to juggle multiple tools. CommuniCare is a free all-in-one mobile application that bridges the communication gap between the deaf/mute community and the hearing world. Built with Flutter and powered by AI, it integrates four features: (1) gamified American Sign Language (ASL) lessons with original animations and rewards; (2) real-time sign recognition using MediaPipe through the device camera; (3) live captions that convert speech to on-screen text; and (4) AI sound alerts that detect alarms, doorbells, and horns and notify users through vibration and visual cues. A working prototype of the gamified learning module, with basic recognition of "Hello" and "Thank You", has been developed, and the live caption and sound alert modules are in progress. Analysis of five competing apps found none that combine all four features free of charge. Pilot testing with the community at KLCC Park. CommuniCare aims to make sign language accessible, keep deaf users safe and connected, and foster a more inclusive society.