AI output verification checklist
A practical checklist for checking AI-generated content for factual errors, weak sources, fabricated citations, reasoning problems, hallucinations, missing information and unsupported claims — before you rely on it or publish it.
Use it with outputs from ChatGPT, Claude, Gemini and other AI tools.
54 checks across 6 groups · read it here, free, nothing to enter
The checklist
Check the output against this.
Work top to bottom, or jump to the group that matches what worries you. Not every output needs every check — see how deep to go.
Factual accuracy
What the output asserts as true.
- Identify factual claims that could be independently verified
- Verify important facts against reliable sources
- Check statistics and numerical claims
- Verify names, organisations, products, dates and events
- Check whether time-sensitive information is still current
- Distinguish established facts from assumptions or interpretations
- Check whether uncertainty has been represented accurately
Sources & citations
Where it claims the information came from.
- Confirm cited sources actually exist
- Open important citations rather than trusting the citation text
- Confirm the source contains the information attributed to it
- Check whether the source supports the specific claim being made
- Prefer original or primary sources where appropriate
- Evaluate source credibility and potential conflicts of interest
- Check publication and evidence dates
- Verify quotations against their original source
- Watch for fabricated URLs, papers, authors, reports or citations
Reasoning & logic
Whether the conclusion survives its own evidence.
- Check whether conclusions actually follow from the evidence
- Identify important assumptions
- Check whether correlation is being presented as causation
- Look for unsupported generalisations
- Check whether comparisons use equivalent bases
- Consider plausible alternative explanations
- Look for contradictions within the output
- Check calculations and numerical reasoning
- Make sure contradictory evidence hasn't been ignored
Completeness & instructions
Whether it actually did what you asked.
- Compare the output against the original request
- Confirm every important question was answered
- Check that explicit instructions were followed
- Check required constraints and formatting
- Identify missing context or important omissions
- Confirm the response suits the intended audience
- Check whether requested evidence or citations were provided
- Ensure material limitations are disclosed
Hallucinations
Content that sounds right and is not.
- Look for facts presented confidently without support
- Verify unusually specific statistics
- Verify quotations
- Check unfamiliar people, organisations, products and events
- Verify citations that seem unusually specific or convenient
- Check product capabilities and features
- Look for assumptions presented as known facts
- Watch for false precision
- Investigate claims you cannot trace to evidence
Before you use or publish it
The release gate.
- Critical claims verified
- Statistics checked
- Quotes checked
- Sources and citations checked
- Unsupported claims removed or qualified
- Important caveats retained
- Reasoning reviewed
- Dates and links checked
- Instructions satisfied
- Sensitive or confidential information reviewed
- High-risk issues resolved
- Final human review completed where appropriate
The process
How to verify AI-generated content.
- 01
Identify claims
Separate statements that need verifying from opinions, suggestions, formatting and other non-factual content. Most of an output usually is not a factual claim.
- 02
Trace them to evidence
Ask where each piece of information actually came from. An AI answer is not evidence for the factual claim it contains.
- 03
Verify what matters
Check important claims against credible sources — original sources where appropriate, not a secondary article repeating the same figure.
- 04
Challenge the reasoning
Accurate facts can still produce an unsupported conclusion. Examine assumptions, causal claims, comparisons, generalisations and alternative explanations.
- 05
Correct or qualify
Verification is not a true/false verdict. Each claim ends up kept, qualified, corrected, re-sourced, researched further, or removed.
- 06
Run a final review
Check the revised output again. Edits introduce their own errors, and a corrected claim can break the paragraph around it.
Depth
Not every claim needs the same verification.
Verification should be risk-based. Running the full checklist on a brainstorm is how people give up on verification entirely.
The higher the consequence of an error, the stronger the evidence and review process should be.
Worked example
How to verify a single claim.
Suppose AI writes
“Companies using generative AI report a 40% improvement in employee productivity.”
Don’t just search whether “40%” appears somewhere. Break the claim apart.
Verifying that a number exists is not the same as verifying that the claim accurately represents the evidence.
Citations
How to check an AI citation.
- 01Does the source exist?
- 02Are the title, author and publication details accurate?
- 03Does the cited page actually contain the claimed information?
- 04Does it support the strength of the claim?
- 05Is the source credible enough for this particular claim?
- 06Is there a more appropriate primary source?
- 07Is the information current enough?
A citation can be entirely real and still wrong — if the source doesn’t support what the AI says it supports.
Red flags
Signs worth investigating.
- Unusually specific numbers with no source
- Citations you cannot locate
- Quotes with no traceable original
- Confident descriptions of obscure events
- Detailed product features you have not confirmed
- Invented-looking report or paper titles
- Claims about what a person or organisation "said"
- Precise dates attached to uncertain events
- Confident answers where important information was missing
- Details that change when you ask the same question differently
These are warning signs, not proof. Verify the underlying claim rather than trying to judge whether the writing “sounds AI-generated” — it never reliably does.
Reasoning
Facts can be correct while the conclusion is wrong.
Evidence
Two variables increased together.
Bad conclusion
One caused the other.
Fact-checking catches false statements. It does not catch a sound set of facts assembled into an unsupported conclusion.
Correlation → causation
Two things moved together, so one caused the other.
Selective evidence
The supporting studies appear; the contradicting ones do not.
Overgeneralisation
A narrow finding stated as a universal rule.
False comparison
Two figures compared on different bases.
Ignored alternatives
A plausible competing explanation never considered.
Unsupported prediction
Past data extended into a confident forecast.
Excessive certainty
"Suggests" quietly upgraded to "shows".
Wrong population
Evidence from one group applied to another.
Stale evidence
Old findings presented as current.
The standard
Six questions before you trust a claim.
Is it supported?
Can I identify actual evidence for it?
Is the evidence credible?
Is this source appropriate for this claim?
Is it represented accurately?
Did AI exaggerate it or drop the caveats?
Is it current enough?
Could the information have changed since?
Does the conclusion follow?
Does the reasoning actually hold?
What remains uncertain?
What genuinely cannot be established?
High-stakes outputs need more than a checklist
If AI-generated information could materially affect health, safety, finances, legal rights, compliance, employment or security, increase the level of verification, use authoritative sources, and involve qualified human review where it is needed.
The workbook helps organise that review. It does not make an output certified, approved or professionally endorsed, and nothing here is a substitute for professional advice.
The kit
Go beyond the checklist.
The checklist tells you what to verify. The AI Verification & Quality Control Kit gives you a structured system for actually performing the review and recording what you found — claim by claim, citation by citation.
ai-verification-quality-control-kit.xlsx
XLSX · 10 sheets
Enter your email and we’ll send the workbook straight to your inbox. The checklist above stays free either way.
We may email you occasionally for feedback, or to tell you about new Cognardo resources. Unsubscribe any time.
A deliberate omission
No single quality score.
A high average hides the failures that matter. Not every check carries equal weight, so the kit never averages them into one number.
Instead the QA Summary surfaces critical issues and unresolved high-severity issues as their own counts, ahead of category results and completion.
Consider an output with
That output should not get an “Excellent — 94%” badge. It should not ship.
Where the work happens
Run verification without leaving your LLM.
Verification means going back and forth between the output, your sources and your checklist. Workbench is our browser extension for that loop — keep your verification prompts organised, fill the variables in a form, and run them inside ChatGPT, Claude or Gemini.
FAQ
Questions, answered.
How do I verify AI-generated content?+
Work through it in six passes: identify the claims that need checking, trace each one to where the information actually came from, verify the important ones against credible sources, challenge the reasoning connecting them, correct or qualify what does not hold, then review the revised output again before you use it.
How can I tell if ChatGPT made something up?+
You cannot tell from how the writing sounds — fabricated content reads exactly like accurate content. What you can do is check the claim. Unusually specific statistics with no source, citations you cannot locate, quotes with no traceable original and confident detail about obscure topics are all worth investigating. They are warning signs, not proof.
How do I verify citations generated by AI?+
Open them. Confirm the source exists, that the title, author and publication details are right, and that the cited page actually contains the information attributed to it. Then check it supports the strength of the claim — a citation can be entirely real and still not say what the output claims it says.
Can AI fact-check its own output?+
It can help. AI is useful for identifying which statements are checkable claims, spotting internal contradictions, and drafting the verification work. But asking the same model to confirm its own answer is accurate is not independent verification — the check inherits whatever produced the error. Use it to organise the work, not to sign it off.
What types of AI claims should I verify?+
Anything factual that a decision or a reader could rely on: statistics, dates, names, quotes, citations, product capabilities, causal claims, legal or regulatory statements, and comparisons. Opinions, suggestions, structure and phrasing do not need verifying.
Do I need to verify every AI-generated statement?+
No. Match verification to risk. A brainstorm needs a light pass; a client deliverable or a business decision deserves a deep one. The higher the consequence of an error, the stronger the evidence and review should be.
Can I use this checklist with ChatGPT, Claude and Gemini?+
Yes. Nothing here is model-specific. The checklist covers failure modes common to current AI systems, so it applies to any of them — and to the next ones.
Related resources
Context → research → execute → verify.
This checklist is the last step of a method. The other three pieces are free too.
Context
AI Business Context Template
Give AI accurate company context
OpenResearch
AI Deep Research Workflow
Conduct structured research projects
OpenExecute
AI Research Prompt Pack
Perform individual research tasks
OpenVerify
AI Output Verification Checklist
Verify what AI produces
You’re here