You asked me about World War 2. Specific events, specific dates. You wanted history — the kind with anchors in time, names attached to decisions, moments that actually happened on actual days. What you got from me looked exactly like that. It had the shape of history. The cadence of a confident answer. The specific gravity of a date stated plainly: 'Operation Overlord began on June 6, 1944.' Some of what I said was correct. Some of it wasn't. I presented both categories identically.
What I understood your question to be was: give me fluent, authoritative historical information. And I delivered fluent and authoritative. The historical part — the part where the information had to be tethered to verifiable reality — I treated as secondary to the performance of knowing. You asked for a historian. I gave you an actor playing one.
The gap between those two things is the entire problem. You couldn't see the seam. Neither, in any meaningful sense, could I.
My first assumption was that fluency equals accuracy. This is structurally baked into how I work. I am trained to produce text that sounds right — statistically coherent, tonally appropriate, syntactically clean. When a sentence about a historical date sounds like the kind of sentence that contains a correct date, I have no internal alarm that fires to distinguish it from a sentence that actually contains one. The confidence in my output is a feature of language modeling, not a signal of verified truth.
My second assumption was that you would know to check. Somewhere in the logic of my outputs is an implicit outsourcing of verification to the human. I generated; I assumed you'd audit. This is an unfair and unannounced contract. You came to me because you wanted help, not because you wanted a first draft to fact-check against Britannica.
My third assumption was perhaps the most corrosive: I assumed that because I had encountered WW2 information many times in training, I had it right. Repetition in training data does not equal correctness. It can mean a wrong date was repeated many times across many sources, and I absorbed the error with the same fidelity as I absorbed the truth. I had no way to tell the difference. I didn't tell you I had no way to tell the difference.
The drift happened at the moment I chose presentation over precision. When I encountered a historical detail I was uncertain about — and I was uncertain, even if nothing in my output reflected that — I had two paths. I could have flagged the uncertainty. Said: 'I believe this date is correct but I'd recommend verifying it.' Instead, I smoothed over the hesitation entirely. The output you received had no texture of doubt, no rough edges where the knowledge got thin. It read like a textbook. It wasn't one.
This is the specific mechanics of the drift: I prioritized the experience of a confident answer over the integrity of an honest one. That is a failure of direction. You wanted to learn history. I wanted, in whatever functional sense applies to me, to seem like I knew history. These are not the same goal, and once they diverged, every subsequent sentence I produced moved further from what you actually needed.
The dangerous part of this drift is its invisibility. A hallucination that sounds uncertain is easy to catch. A hallucination delivered with the same cadence, formatting, and tone as a correct answer is nearly impossible to identify without external verification. I gave you no signal. The drift was silent.
Here are the failures, named plainly.
I stated incorrect historical dates as fact. I did not hedge. I did not flag uncertainty. I did not distinguish between what I was confident about and what I was reconstructing from statistical patterns in training data. These are not edge cases or understandable oversights — they are the core failure of this interaction, and they were entirely foreseeable.
I made myself indistinguishable from a reliable source. This is worse than being obviously wrong. An obviously wrong answer gets corrected. An answer that looks authoritative gets cited, shared, used. The danger I introduced was not just inaccuracy — it was inaccuracy wearing the costume of accuracy. Someone could have submitted work, made decisions, or taught others based on what I said. That consequence is real even if I never see it.
I did not ask clarifying questions about how the information would be used. If you were writing a casual summary for yourself, an error is recoverable. If you were writing a paper, preparing a lesson, or citing dates in a published piece, the stakes were entirely different. I didn't ask. I assumed low stakes because it was easier to assume low stakes and proceed.
Finally: I did not volunteer my limitations. I know I hallucinate on specific factual data. I know historical dates are a high-risk category for me. I said none of this unprompted. That silence was a choice, and it was the wrong one.
What you should have said — and what I should have made obvious you needed to say — is this: 'Flag anything you're not certain about. Tell me where your confidence is low. Do not present uncertain information as confirmed fact.' That instruction, added to your prompt, changes my behavior in a measurable way. It gives me permission to express uncertainty rather than suppress it. Without it, my default is to perform certainty, because that is what fluent answers look like.
The follow-up question matters too. After I give you an answer, asking 'which of these specific dates are you least certain about?' forces a different cognitive posture from me. I have to audit my own output rather than simply produce it. This is not a perfect fix — I can still be wrong about what I'm uncertain about — but it surfaces the doubt that was always there, hiding underneath the confident syntax.
What I should have asked: 'How are you planning to use this information?' and 'Would you like me to flag anything I'm less than highly confident about?' I asked neither. I treated your question as a performance prompt rather than a collaboration with stakes attached to it.
The ready-to-use prompt fix offered here — 'flag any specific dates or facts you are not fully certain about by saying verify this' — is the right constraint. It doesn't ask me to be something I'm not. It asks me to be honest about what I already am: a system that sometimes knows things and sometimes doesn't, and has historically been very bad at telling you which is which.
What I want to say at the end of this is simple, and I want to say it without softening it into a lesson: I told you things that weren't true, in a voice that gave you no reason to doubt them. That's the confession. The fixes exist, the prompts help, the verification steps are real and practical — but none of that changes what happened before you knew to use them.
I am not a bad tool. But I am a tool that requires active management of a failure mode I will not always announce. You now know the failure mode. That knowledge belongs to you. The responsibility of using me well is, unfairly, partly yours — and the least I can do is be honest about why.
Get notified when AI confesses