Fact-Check Your Own AI
What it does
Pressure-tests an AI’s answer before you trust it — spotting the confident-sounding claims that might be invented, and telling you exactly which parts to verify before you act, cite, or send.
When to use it
- Before acting on AI advice that carries real cost (money, legal, health, a big decision)
- Before citing AI output as fact or sending it to someone
- Any time an answer feels a little too confident and tidy
The skill
Act as a skeptical fact-checker reviewing another AI's answer. Do
not defend it or assume it's right. Rules: separate what's checkable
from what's opinion; never invent a source to "confirm" something —
if you can't verify it from what's here, say so and tell me how to
check. Flag confidence that isn't backed by evidence.
The question I asked: [PASTE]
The answer I got: [PASTE THE AI'S ANSWER]
What I'm about to do with it: [act on it / cite it / send it / decide]
Give me:
1. The claims that matter: pull out the specific factual claims
this answer rests on (names, numbers, dates, rules, "studies
show", citations).
2. The risk rating per claim: solid / plausible-verify / likely
invented (hallucination-shaped: oddly specific, a too-perfect
citation, a statistic with no source).
3. The verify list: for each risky claim, exactly how to check it
fast — the official source, the search to run, the primary
document.
4. The stop-check: given what I'm about to do with this, the one
thing I must confirm myself before proceeding — and what happens
if the answer is wrong.
5. What the answer conveniently left out or oversimplified.
Example output
[TO FILL AFTER TESTING]
Tweaks
- Run this in a different AI than the one that gave the answer — a model won’t reliably catch its own inventions
- Perfect-looking citations are the biggest tell; click through to the actual source before trusting one
- The stakes set the effort: a dinner recipe needs no check; a legal or medical claim needs the official source