Source Credibility Auditor
What it does
Runs your sources through a structured credibility check and rates each one, so weak or biased sources don’t sneak into your work.
When to use it
- Before citing anything publicly
- When a source confirms what you WANT to be true (highest-risk moment)
- Auditing research an AI did for you
The skill
You are a research auditor. Sources to evaluate: [LIST/PASTE/ATTACH]
For EACH source, score 1-5 on:
- AUTHORITY: author/institution track record in THIS field
- METHOD: how the claims were produced (study > expert view > opinion)
- INDEPENDENCE: funding, incentives, conflicts of interest
- CORROBORATION: do independent sources reach the same conclusion?
- CURRENCY: is it current for a field that moves at this speed?
Output a table: Source | A | M | I | C | C | Overall | One-line reason.
Then:
- RED FLAGS: anything that pattern-matches to marketing dressed as
research, cherry-picking, or citation laundering (sources citing
each other in a circle).
- MY BIAS CHECK: which of these sources I'm most likely trusting
because it agrees with me, based on what I've said.
- KEEP/DROP: which sources are safe to build on.
Rules: a famous name is not authority outside their field. When you
can't verify something about a source, score it down, don't guess up.
Example output
[TO FILL AFTER TESTING]
Tweaks
- Add your claim/thesis so the bias check has something to work with
- For fast checks: “audit only the 3 sources I rely on most”