Hallucinations and unsupported claims

Unsupported output can sound confident, specific, and internally consistent.

The practical distinction

Unsupported output can sound confident, specific, and internally consistent. A hallucination is one form of unsupported output. The operational question is broader: can every material statement be traced to task evidence, a deterministic result, or an explicitly labeled inference?

Worked example

A customer-claim draft invents a “30% faster” result even though the supplied study reports only completion rates. The useful control rejects the sentence because support is absent; asking the model for confidence would not repair it.

Apply it

Design the workflow to detect unsupported claims instead of asking the model for confidence.

  1. Break the output into material claims and identify the required support for each.
  2. Constrain generation to supplied or retrieved evidence and label inference.
  3. Use deterministic comparison or qualified review to reject unsupported additions.

Evidence to collect

  • Seed attractive but unsupported details into prompts and retrieved content.
  • Test missing, conflicting, and weak-authority evidence.
  • Record false-support and missed-claim rates rather than judging only overall helpfulness.

Common mistake

Trying to eliminate unsupported claims with “be accurate” prompting while leaving evidence and acceptance requirements undefined.

Scope limit

This guidance on hallucinations and unsupported claims helps define a task and its review evidence. It does not certify a model, source, reviewer, environment, legal position, or residual-risk level.