MediQuery: Multi-agent medical QA
2026 · Co-authored with Kunal Tamhane
Medical question answering that stops instead of guessing when no source comes back.
Manuscript in preparation
How it works for MediQuery
- Problem
- Language models answer medical questions confidently even when no evidence supports the answer.
- Approach
- A LangGraph supervisor orchestrates three retrieval agents (PubMedBERT embeddings in Qdrant, NCBI, web search), and answers are generated through Amazon Bedrock. We also fine-tuned Llama 3 8B with 4-bit QLoRA on PubMedQA. A circuit breaker returns an insufficient-evidence reply instead of guessing when no agent finds a source.
- Evaluation
- Pilot: the full pipeline scored 0.92 BERTScore-F1 on 5 PubMedQA questions.
3 retrieval agents + circuit breaker