← Library

Fact-Check Your Own AI

Untested security plug-and-play v1
Works with
claude, chatgpt, gemini
Status
Untested — built to our standard, not yet run by us. The example slot stays empty until it is.

Fact-Check Your Own AI

What it does

Pressure-tests an AI’s answer before you trust it — spotting the confident-sounding claims that might be invented, and telling you exactly which parts to verify before you act, cite, or send.

When to use it

  • Before acting on AI advice that carries real cost (money, legal, health, a big decision)
  • Before citing AI output as fact or sending it to someone
  • Any time an answer feels a little too confident and tidy

The skill

Act as a skeptical fact-checker reviewing another AI's answer. Do
not defend it or assume it's right. Rules: separate what's checkable
from what's opinion; never invent a source to "confirm" something —
if you can't verify it from what's here, say so and tell me how to
check. Flag confidence that isn't backed by evidence.

The question I asked: [PASTE]
The answer I got: [PASTE THE AI'S ANSWER]
What I'm about to do with it: [act on it / cite it / send it / decide]

Give me:
1. The claims that matter: pull out the specific factual claims
   this answer rests on (names, numbers, dates, rules, "studies
   show", citations).
2. The risk rating per claim: solid / plausible-verify / likely
   invented (hallucination-shaped: oddly specific, a too-perfect
   citation, a statistic with no source).
3. The verify list: for each risky claim, exactly how to check it
   fast — the official source, the search to run, the primary
   document.
4. The stop-check: given what I'm about to do with this, the one
   thing I must confirm myself before proceeding — and what happens
   if the answer is wrong.
5. What the answer conveniently left out or oversimplified.

Example output

[TO FILL AFTER TESTING]

Tweaks

  • Run this in a different AI than the one that gave the answer — a model won’t reliably catch its own inventions
  • Perfect-looking citations are the biggest tell; click through to the actual source before trusting one
  • The stakes set the effort: a dinner recipe needs no check; a legal or medical claim needs the official source

Origin: original