The Fact-Checker’s Pocket Checklist: Navigating AI Workflows
To ensure you don’t overlook critical verification steps and to maintain a skeptical eye on AI-generated results, use this pocket checklist. While it can be tailored to specific tasks, the core principle remains: AI is a tool for discovery, not a replacement for your expertise.
Before the Query:
- Have I clearly defined exactly what needs to be verified (dates, figures, quotes, or relationships)?
- Have I broken down complex claims into simple, manageable components?
- Have I identified which authoritative sources should be prioritized for cross-referencing?
During the AI Dialogue:
- Did I provide sufficient context and specify timeframes in the prompt?
- Did I explicitly ask the AI to cite its sources?
- If the AI provided figures or dates, did I immediately clarify: “Is this precise data or an estimate?”
- Did I ask a follow-up question: “What are the potential weaknesses or gaps in this analysis?”
After Receiving the Response:
- Have I cross-referenced key facts (dates, names, numbers) against authoritative, independent sources?
- Have I located the original documents or research studies the AI referenced?
- Have I compared the AI’s conclusion with alternative perspectives?
- Did I assess whether the AI’s conclusion became more definitive or “sharper” than the original source material?
- Have I saved links to all sources used to ensure transparency?
Red Flags (If the AI):
- Fails to provide specific, verifiable sources.
- Uses vague phrasing (e.g., “experts believe,” “it is widely said,” “studies show”).
- Becomes inconsistent with terms or dates during follow-up clarifications.
- Cites sources or links that cannot be located within five minutes of searching.
The Final Step:
- Drafted the conclusion independently rather than copy-pasting the AI’s output.
- Clearly stated which data the final conclusion is based on.
- Added a disclaimer regarding the limitations of the verification (e.g., “Verified based on data available as of [Date]”).
Making this checklist a regular part of your workflow will turn critical AI verification into a second-nature habit. Over time, these steps will become automatic, allowing you to focus on the depth of your analysis rather than just process control. To dive deeper into the logic behind each of these steps, refer back to our detailed guide: “AI for Fact-Checking: A User Manual.”