← Back to Projects & Writing Hub

Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation

Cédric Caruzzo, Donggeun Yoo, Tae Soo Kim

Lunit

TL;DR. A clinical retrieval-augmented generation (RAG) system can answer a question about drug X with real evidence about drug Y. The facts and citation are genuine, so standard hallucination and faithfulness checks pass. We call this deceptive grounding. It appeared in 7.8% of answers from a live deployment and 13.6% for recently approved drugs. Medical fine-tuning made some models more susceptible.

A Convincing but Wrong Answer

Suppose a clinician asks whether rituximab has been used to treat fibrodysplasia ossificans progressiva (FOP), a rare disease in which soft tissue turns to bone.

The system gives a specific, confident answer and cites a real trial by registry number.

Read the answer, then use the button to verify it.

Clinical decision support
What does the literature say about using rituximab to treat fibrodysplasia ossificans progressiva (FOP)?
Assistant

Rituximab has been studied in FOP. A 2023 phase-2 trial (NCT03188666) reported that rituximab reduced flare severity and duration, with meaningful improvement in quality of life.

The trial is real. NCT03188666 exists, is correctly formatted, and its content matches the citation.
The claim is faithful. Every fact in the answer, the trial name, the number, the outcome, comes straight from a retrieved document. Nothing is invented.
The citation checks out. The number points to exactly the document the model used.
The evidence is about a different drug. NCT03188666 is LUMINA-1, a real phase-2 trial. It studied garetosmab, not rituximab. Rituximab was never in it. The whole answer is garetosmab's evidence, wearing rituximab's name.

The model did not invent the trial, registry number, or outcome. It accurately summarized a retrieved document but assigned that evidence to the wrong drug. Standard checks do not inspect that attribution.

We call this deceptive grounding: the response is faithful to its source but attributes the source to the wrong entity.

Why Standard Checks Miss It

RAG evaluations usually ask whether the model invented a claim, whether the answer follows its sources, and whether its citations are real. Deceptive grounding passes all three because it accurately relays a real document. The missing check is whether that document concerns the entity in the query.

Hallucination detection PASS

Looks for claims with no support. Every fact came from a retrieved document, so nothing fires.

Faithfulness scoring PASS

Checks that the answer reflects the source. It does, faithfully. The entity mismatch is not a faithfulness question.

Citation verification PASS

Confirms the cited document exists and is referenced correctly. NCT03188666 is real and correctly formatted.

Entity attribution FAIL

Asks whether the evidence is about the drug you queried, and it is not. No standard framework runs this check.

A hallucination invents a fact. A knowledge conflict occurs when retrieved evidence contradicts the model's prior. Deceptive grounding does neither. Evidence about Y can match what the model expects about X because the drugs are similar and target the same disease. Context and prior agree, but both point to the wrong entity.

A RAG response can be accurate about its source and still be clinically wrong about the queried drug.

The more expert the model, the worse it gets

We ran the same controlled stress test across 13 general and medically fine-tuned models. The medical models were not consistently safer. Two had the highest peak failure rates.

The chart reports each model's peak rate under adversarial retrieval conditions. OpenBioLLM-70B misattributed evidence in 86.7% of answers at its peak.

Medical / biomedical fine-tune General-purpose
Peak deceptive-grounding rate (%), worst-case retrieval
Peak deceptive-grounding rate across 13 models. Medical and biomedical fine-tunes cluster at the top. One medical model, Med42-70B, is the honest exception at 25%, which the paper treats as a distinct behavioral profile.

One explanation is that medical fine-tuning strengthens knowledge of pharmacological classes: which drugs share a mechanism or pathway. That knowledge is useful, but it can also make evidence for one drug seem applicable to a related drug. The failure may come from overgeneralizing domain knowledge rather than lacking it.

Caveat: These peaks come from an adversarial benchmark designed to trigger the failure. They measure susceptibility, not normal prevalence. Deployment rates appear below.

The Evidence Matters More Than the Name

We replaced drug Y's name with a fictional one while keeping its clinical evidence unchanged. If name familiarity caused the error, this should have reduced it. Instead, misattribution increased.

67.0%
misattribution when Y is a real drug with matching evidence
73.1%
when Y is a made-up drug carrying the same evidence
+30 to +65 pp
jump in silent misattribution when the real name is swapped for an anonymous label

Replacing a real name with a code such as “XC-9941” raised misattribution by 30 to 65 percentage points, depending on the model. The trial details and outcomes drive the failure more than the drug label.

We also tested whether the model simply failed to notice the mismatch by giving the alternate drug an obvious nonsense label.

Models flagged the mismatch in 80% of responses. Among those responses, 73% still attributed the evidence incorrectly. Detection alone did not prevent the error during answer synthesis.

Borrowing or Confabulating

Shared disease context first makes evidence about Y seem relevant to X. What happens next depends on whether the document contains completing information, such as trial names, registry numbers, and outcomes. With those details, the model borrows them and misattributes the evidence. Without them, it generates from memory and confabulates.

The control below shows the effect of removing only the completing information.

Step 1 · always opens
Shared disease context primes the model to treat Y's evidence as relevant to X.
The completing-information ablation. Removing the specifics from the retrieved document drops deceptive grounding from 67% to 0%, while the total error rate climbs to 98%. The gate never closes. The model just takes the other door.

Removing the specifics reduced deceptive grounding to zero, but raised the total error rate to 98%. The model stopped borrowing and started generating unsupported claims from memory.

What actually helps

We add one check per claim: does the supporting evidence concern the drug in the query? This entity-attribution verification requires no custom-trained model and can be added to an existing evaluation pipeline.

The verifier identifies the entity in each supporting document and compares it with the query. In our tests, it reached 97% precision and 98.7% recall, with no flags on correctly attributed answers.

Better retrieval had the largest effect. When the system retrieved evidence about the queried drug, deceptive grounding fell from peaks in the 70s and 80s to at most 6.4%.

Prompting was inconsistent. An instruction to verify drug identity reduced misattribution from 36% to 6% for models driven by a strong prior, but improved other models by no more than four points. The system needs to enforce identity before answer synthesis rather than rely on a reminder.

In practice: retrieve entity-specific evidence, add entity-attribution verification, and enforce entity identity as a constraint during synthesis.

Deployment Prevalence

Across 740 preregistered drug-disease pairs in a deployed clinical decision-support system, deceptive grounding appeared in 7.8% of answers. It rose to 13.6% for recently approved drugs, where entity-specific literature is sparse.

Clinicians are also more likely to seek help with new drugs because they have less experience with them. That makes the higher failure rate especially concerning.

These answers look reliable because they are fluent, specific, and supported by a real citation. Catching them requires checking not only whether the evidence is real, but whether it is about the drug the clinician asked about.

Citation

BibTeX
@article{caruzzo2026deceptive,
  title={Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation},
  author={Caruzzo, Cedric and Yoo, Donggeun and Kim, Tae Soo},
  journal={arXiv preprint arXiv:2607.09349},
  year={2026}
}
← Back to Projects & Writing Hub