MedSpeak: Knowledge Graph-Aided ASR Error Correction for Medical Speech

This skill enables Claude to build ASR error correction systems that leverage a dual-representation medical knowledge graph (semantic + phonetic) to identify and fix misrecognized medical terminology in speech transcriptions. The core technique from MedSpeak (arXiv:2602.00981) combines UMLS-derived semantic relationships with Double Metaphone phonetic encoding and Levenshtein distance filtering, then feeds structured evidence into an LLM to jointly correct transcripts and answer medical questions. This approach reduced word error rate from 77.2% to 29.9% and boosted QA accuracy from 50.2% to 93.4% on medical benchmarks.

When to Use

• When the user needs to correct medical terminology errors in ASR/Whisper transcriptions (e.g., "chorioamnionitis" misrecognized instead of "chorioretinitis")
• When building a spoken medical QA system that must handle noisy audio input
• When the user wants to construct a phonetic similarity index for domain-specific vocabulary (medical, legal, pharmaceutical)
• When integrating knowledge graphs into an NLP pipeline to ground LLM corrections in structured medical knowledge
• When the user asks to improve Whisper or other ASR model output for clinical, biomedical, or healthcare content
• When building retrieval-augmented generation (RAG) pipelines where the retrieval source is a medical knowledge graph rather than a vector store

Key Technique

Dual Knowledge Graph Representation. MedSpeak constructs two complementary views from the UMLS Metathesaurus (specifically the MRREL relationship table): (1) a semantic KG stored in SQLite that captures medical concept relationships (classifies, constitutes, due_to, plays_role), and (2) a phonetic KG stored as JSONL that maps each medical term to its Double Metaphone encoding and lists phonetically similar terms within a Levenshtein distance threshold. The semantic KG tells the LLM what concepts are medically related; the phonetic KG tells it what the ASR system might have confused.

Retrieval-then-Correct Pipeline. Given a noisy ASR transcript, the system extracts candidate terms and queries both KG representations. Semantic retrieval pulls related medical concepts (budgeted at ~600 tokens), while phonetic retrieval identifies sound-alike terms that the ASR may have substituted (~300 tokens). These evidence snippets are injected into the LLM prompt alongside the noisy transcript and any answer options. The LLM then performs two joint tasks: (1) output a corrected transcript, and (2) select the correct answer. This joint formulation is critical -- correction without the downstream task objective produces weaker results.