Accessibility AI
VisionSathi
Offline-first AI assistant for blind users. On-device Moondream 3 (2B params) runs without internet.
About the Project
VisionSathi ('Vision Friend' in Hindi) is an offline-first visual assistant designed specifically for blind and visually impaired users. The app runs a quantized Moondream 3 vision-language model directly on mobile devices, enabling users to understand their visual environment without requiring internet connectivity. Features include instant scene description, text reading (OCR), and obstacle detection with directional guidance.
Key Features
- On-device inference with quantized 2B parameter Moondream 3 model
- WCAG AAA compliant with 7:1 contrast ratio for maximum accessibility
- Multiple interaction modes: Quick Tap, Conversation, OCR, Navigation
- Cloud fallback after 5s timeout ensures reliability
- Full VoiceOver (iOS) and TalkBack (Android) support
Impact
Designed to help millions of visually impaired users in India gain independence through AI-powered visual assistance.
Tech Stack
React NativeExpoONNX RuntimeMoondream 3FastAPIZustand
Metrics
WCAG AAA compliant
7:1 contrast ratio
46% complete
Interested in this project?
Let's discuss how I can build something similar for you.