Fri Oct 20 2023
OCR Study Website
React
Python
WebSockets
OpenSearch
OpenAI
This freelance learning product helps students in classes VI–X turn a physical textbook into an interactive study session. A live book view is used to identify the subject, chapter, sub-chapter, and page; the app then surfaces the most relevant videos, MCQs, and help instead of making the student hunt through a catalogue.
Three modes:
- Automatic — continuous recognition of what the student is reading.
- Manual crop — draw a rectangle on the page; OpenSearch finds the matching unit and OpenAI answers the doubt.
- Voice — browser speech-to-text in, text-to-speech out.
I owned the frontend, backend, WebSocket updates, and the retrieval loop. The key design challenge was making the AI feel grounded in the page the learner was actually reading, so the flow deliberately follows capture → parse → retrieve → generate. That keeps answers useful, contextual, and much less like a generic chatbot.