Check ChatGPT sources: from citation to original publication
Find the publication, compare DOI and metadata, and read the original passage before using an AI-generated reference.
Which errors can occur?
A source may be entirely fabricated or refer to a real work with the wrong year, altered title or another article’s DOI. Asking the chatbot to confirm its own answer is not independent evidence.
Walters and Wilder’s 2023 study found fabricated publications and errors in real references generated with GPT-3.5 and GPT-4. Its results concern those models and that sample; they do not establish an error rate for current ChatGPT versions.
Check a source step by step
1. Preserve title, authors, year, journal or publisher and DOI or ISBN, together with the sentence the source is meant to support. This separates bibliographic corrections from content verification.
2. Open the DOI through doi.org and compare the publication. A working identifier can point to a different work. Without a DOI, search the exact title and an author in a suitable research index, library catalogue or repository.
3. Compare authorship, title, year and venue. For books, check the edition; for articles, check volume, issue and pages or article number. Online-first dates and later editions can explain a year difference. Correct it only after identifying the version used.
4. Read the passage in context. Does the population, method and research question support your claim? Is the paper reporting its own finding or citing another source? Record the relevant page or section using your institution’s requirements.
Example: a real DOI with an intentionally wrong year
This teaching example changes only the year of a real publication. It is a constructed error, not a documented ChatGPT output or a Veracite performance test.
Example citation: Walters & Wilder, 2024. Original record: William H. Walters and Esther Isabelle Wilder, 2023, Scientific Reports, volume 13, article 14045. DOI: 10.1038/s41598-023-41032-5.
The publication exists; the example year is wrong. Calling the source fabricated would be incorrect. You must still read the text to establish whether it supports your specific sentence.
What if no source can be found?
Try spelling variants, the publisher’s catalogue and another relevant database. Coverage gaps, new publications, transcription errors and technical outages can all obstruct discovery.
If you cannot independently verify the publication, do not use it unchecked. Find a verifiable replacement and read it yourself; another plausible chatbot suggestion does not resolve the uncertainty.
How Veracite supports preliminary checking
Veracite compares references with bibliographic databases and presents matches, metadata differences and unresolved findings with source links. It helps organise and document the bibliography. Checking the paper’s argument and cited page numbers remains a separate task.
Original sources
Check with visible evidence
Veracite compares references with twelve databases and shows matching records, discrepancies and unresolved findings.