DigitalTwinAI
Explainable AI for Preventive Healthcare
Inspiration
India is facing a silent but escalating health crisis — not because treatment is unavailable, but because chronic diseases are detected far too late.
- Heart disease accounts for over 28% of all deaths
- More than 57% of diabetes cases remain undiagnosed
- Nearly 60% of thyroid disorders go unnoticed
In most cases, people only realize something is wrong after complications begin.
During our research, we observed a recurring pattern: people do get blood tests done, but they struggle to understand what those numbers actually mean. Lab reports are fragmented, highly technical, and lack context. Doctors, constrained by time, often don’t have access to a complete longitudinal health picture either.
This gap between data availability and data understanding inspired us to build DigitalTwinAI — a system focused on early awareness, explainability, and prevention, grounded in trusted medical standards.
What It Does
DigitalTwinAI is a WHO-aligned AI Health Digital Twin that helps users interpret blood reports and understand long-term health risks in a clear, explainable, and non-diagnostic manner.
The platform enables users to:
- Upload real blood reports (PDF or image)
- Extract key clinical values using OCR and AI-assisted parsing
- Validate results against WHO South Asia clinical guidelines
- View quantified risk estimates for:
- Diabetes
- Hypertension
- Cardiovascular disease
- Diabetes
- Ask follow-up questions through a constrained health assistant
- Download a physician-ready summary for awareness and discussion
The system is designed strictly for risk awareness and prevention, not diagnosis.
How We Built It
DigitalTwinAI was developed as a modular, end-to-end system:
- Frontend: React (Vite + Tailwind) for a clean, focused UI
- Backend: FastAPI (Python) to orchestrate ingestion, validation, prediction, and explanation
- OCR: Tesseract for extracting text from real-world lab reports
- WHO Validation Engine: Rule-based logic using WHO South Asia clinical thresholds stored in JSON
- Machine Learning: Random Forest models trained offline to estimate disease risk using interacting clinical and lifestyle features
- AI Layer (Gemini 1.5 Flash): Used only for:
- Structured data extraction from OCR output
- Human-readable explanations of risk results
- Generating physician-ready summaries
- Structured data extraction from OCR output
- Deployment: Dockerized frontend and backend for reproducible execution
All medical risk calculations are handled by deterministic logic and trained ML models. The AI does not make medical decisions.
Challenges We Faced
- Parsing inconsistent and noisy real-world lab report formats
- Aligning ML predictions with WHO classifications without overstating or understating risk
- Ensuring AI explanations were helpful yet clearly non-diagnostic
- Reliable frontend–backend integration under tight time constraints
- Designing for explainability instead of black-box outputs
Accomplishments
- Built a fully functional end-to-end system within a 24-hour hackathon
- Successfully integrated OCR, WHO rules, ML prediction, and AI explanation into a single workflow
- Prioritized trust, transparency, and interpretability over raw prediction accuracy
- Generated physician-ready summaries users can realistically share
- Deployed the entire stack using Docker for clean, reproducible execution
What We Learned
- Execution, clarity, and communication matter as much as the idea itself
- In healthcare, explainability is essential for trust
- AI is most powerful when it supports understanding, not replaces judgment
- Building responsibly means knowing where not to use AI
What’s Next for DigitalTwinAI
- Expanding the digital twin to support longitudinal health tracking
- Integrating wearables and continuous vital signals
- Adding vernacular language support for broader accessibility
- Conducting clinical validation studies with partner clinics
- Exploring secure integration with national digital health ecosystems
DigitalTwinAI is a step toward making preventive healthcare more understandable, accessible, and trustworthy — especially in settings where early awareness can significantly change outcomes.
Built With
- axios
- docker
- fastapi
- google-gemini-ai
- python
- react-(vite)
- scikit-learn
- tailwind-css
- tesseract-ocr
- who-guidelines
Log in or sign up for Devpost to join the conversation.