AAYU 2026 Hackathon • Problem T01: The Two-Minute Doctor

Less Documentation.
More Care.

A two-minute clinical pre-consultation summary prepared before the patient steps into the OPD cabin. Autonomous multi-agent intelligence captures ambient symptoms, parses old prescriptions, and flags allergy risks.

2 min to summary
Hindi + English
Doctor-approved

Synthetic test data • ABDM M2 FHIR compliant • Human in the loop

Doctor reviewing a holographic patient summary in a teal and navy clinical palette
Live OPD Scribe Session
Vikramaditya R. • Suspected ACS flagged in 114s
120s Target Met
The Core Bottleneck

The High-Throughput Indian OPD Crisis

With 80+ patients per shift, physicians spend over 60% of their critical consultation minutes deciphering paper slips and typing notes.

1. Limited Consult Time

The average Indian outpatient encounter lasts barely 2.5 minutes. Physicians are forced to prioritize rapid scribbling over deep diagnostic listening.

Impact: 75% clinician burnout & missed subtleties

2. Unstructured History

Previous prescriptions exist as faded paper slips, wrinkled laboratory prints, and fragmented WhatsApp photos with zero chronology or searchable index.

Impact: Redundant tests & repeated examinations

3. Language Barriers

Patients describe symptoms using colloquial rural Hindi idioms. Bridging vernacular speech into formal SNOMED CT and ICD-10 notes in real time creates friction.

Impact: Miscommunicated dosages & lost symptoms
Interactive Product Presentation

How Industra Medicose Works in Action

Step-by-step interactive showcase demonstrating how autonomous agents synthesize voice, OCR, and safety checks in under 120 seconds.

1Step 1 of 5Latency: < 350ms • Web Speech Scribe

Patient Speaks in Hindi or English (Zero Typing)

Vernacular speech captured in waiting halls while patient waits

The patient opens their phone or uses the OPD kiosk microphone. They speak naturally in Hindi, English, or conversational Hinglish. Ambient agents filter clinic background noise, capture onset and severity, and map colloquial words directly to clinical entities.

✓ Hindi + English Speech✓ Zero Patient Typing✓ ABDM Explicit Consent
Ambient Scribe Voice Console
Listening...
Mic Active • hi-IN / en-IN
Live Patient Vernacular Audio

“पिछले 3 दिन से बहुत तेज खांसी और सीने में हल्का दर्द है, सांस लेने में भी तकलीफ हो रही है...”

Autonomous Entities Extracted
Chief Complaint: Dry Cough x 3dSeverity: 7/10 Mod-SevereAssociated: Dyspnea
AAYU 2026 Engine120s Doctor Verified
1 / 5
The 120-Second Pipeline

How Industra Medicose Works

From patient vernacular speech to a signed, verified ABDM electronic health record in five synchronized steps.

1
Whisper Ambient Intake

Patient Speaks in Hindi or English

While waiting in the queue, the patient speaks into their phone or the clinic kiosk microphone. Colloquial descriptions are captured without requiring complex medical vocabulary.

A rural Indian patient speaking to a phone
2
LLM Entity Extraction

Autonomous Agents Structure Clinical Entities

Our Clinical History and Intake agents organize the conversation into onset, duration, severity, and associated symptoms, mapping them to formal ICD-10 & SNOMED CT codes.

3
Multi-Modal OCR

Previous Reports & Prescriptions Are Read

The Document Intelligence Agent performs multi-modal OCR on old handwritten slips and laboratory test photos, extracting active drugs and abnormal biomarkers.

Prescription being scanned by Document Intelligence agent
4
Contraindication Engine

Clinical Safety Check Runs in Real-Time

Safety Guard Agent checks for beta-lactam/penicillin allergies, potential drug-drug collisions, and urgent red flags like acute chest pain or stroke symptoms.

5
ABDM M2 Verified

Doctor Reviews, Edits, and Approves

When the patient enters the cabin, the doctor sees a pre-populated, verified SOAP note. In less than 120 seconds, the doctor performs physical exam, verifies, and signs.

Agentic Multi-Role Framework

Meet the Autonomous Agents

Six specialized agents coordinating synchronously to complete the pre-consultation intake before the doctor opens the door.

Patient Interaction

Latency < 350ms

Guides patient voice conversation with empathy in Hindi or English, clarifying onset and pain severity.

Role: Conversational Scribe & Intake

Clinical History

SNOMED CT

Synthesizes chronic comorbidities, prior surgical history, and family health indicators into an indexed chronology.

Role: Chronological History Structuring

Document Intelligence

Vision OCR

Scans handwritten prescriptions and laboratory slips, extracting active medications, dosages, and abnormal biomarkers.

Role: Physical Records Digitizer

Clinical Safety

Zero Miss

Screening for drug-drug interactions, penicillin and beta-lactam allergies, and urgent red flags like chest pain or stroke.

Role: Real-Time Contraindication Guard

Clinical Documentation

ICD-10 Mapped

Drafts high-density structured SOAP notes ready for doctor sign-off, saving over 4 minutes of typing per consult.

Role: Automated SOAP Note Synthesis

Workflow Coordination

FHIR M2

Orchestrates the 120-second timeline, prioritizes queue triage by acuity, and binds outputs into ABDM FHIR bundles.

Role: OPD Triage & ABDM Dispatch
Product Demonstration

Live Product Preview

Switch between the Patient Intake view and the Doctor Verification Console.

app.industramedicose.in/doctor
ABDM Sandbox Connected
Industra Medicose clean dashboard mockup with doctor triage queue and clinical summary
Dr. Aarav Mehta • OPD General MedicineRed Flag ACS
Vikramaditya Rathore (54M) • 114s Intake Duration

Pre-populated SOAP note prepared with ICD-10 I20.0 (Unstable Angina). Penicillin allergy auto-flagged. One-click verify ready.

Responsible AI Guardrails

Safety and Responsible AI

Industra Medicose never replaces the physician. Built with stringent ethical boundaries, cryptographic audits, and zero autonomous authority.

No Autonomous Diagnosis

The copilot synthesizes clinical history and highlights ICD-10 suggestions, but never renders an autonomous medical diagnosis.

No Autonomous Prescription

Zero medications or dosages can be dispatched without the physical review and digital cryptographic signature of the registered physician.

Human In The Loop

Every draft entity, timeline event, and safety warning is fully editable. The doctor retains complete override authority over all data.

Synthetic Data Benchmark

This prototype evaluates on realistic synthetic de-identified clinical cohorts. Zero real patient Personally Identifiable Information (PII) is exposed.

Explicit Patient Consent

No intake discourse or optical scan can begin without explicit consent presented in simple vernacular Hindi or English, revokable at any time.

Cryptographic Audit Trail

All AI suggestions, physician alterations, and allergy alerts are stamped into an immutable audit log conforming to ABDM M2 milestone guidelines.

Clinic with Mehrangarh-inspired warm tones in Jodhpur Rajasthan
Western Rajasthan Clinical Context

Designed for rural-to-urban OPD influx in Jodhpur & high-density tertiary medical centers.

Strategic Roadmap

Roadmap: Regional Dialects & Hospital Scale

Expanding our clinical copilot across the rural-urban continuum to ensure no patient is left behind due to dialect or paper friction.

1. Marwari & Regional Dialect Speech ModelsQ2 2026

Fine-tuned Whisper models on 5,000+ hours of Marwari, Mewari, and Shekhawati conversational medical speech.

2. Direct Hospital EMR & ABDM M2 IntegrationsQ3 2026

Bi-directional FHIR bundles connecting directly with NIC e-Hospital, Ayush portals, and major private hospital HMIS.

3. WhatsApp & SMS Automated Follow-Up RemindersQ4 2026

Vernacular audio voice notes sent directly to patient phones reminding them of medication dosages and follow-up OPD dates.

Team HPKGSAVVAAYU 2026 Hackathon Finalists

Crafted with Empathy & Clinical Precision

Built by engineering and clinical enthusiasts passionate about transforming high-throughput healthcare delivery across India.

Core Engineering & Product Team
Harshvardhan Purohit
AI & Fullstack
Kanika Gehlot
Clinical Systems
Shefali Agarwal
Product & UI
Vanshika Verma
ML & Verification
Team HPKGSAVV collaborating on Industra Medicose clinical AI
Team HPKGSAVV • SIN Education and Technology Pvt. Ltd.