Everyone’s worried about AI getting things wrong.
Nobody’s talking about the human on the other side of the keyboard.
First, let’s fix the language. When AI produces a wrong answer, the media calls it a “hallucination.” That word is doing a lot of work to protect a lot of people. It implies the AI made something up from nothing — random, accidental, a glitch.
That’s not what’s actually happening.
What’s happening is confluence. The AI is pulling from multiple streams of real information, mixing them together, and producing an output that sounds completely grounded — because it is grounded, just in the wrong combination of things. It’s not random noise. It’s misattributed signal. And misattributed signal is far more dangerous than a hallucination because it passes the smell test.
My own AI recently wrote an article about AI memory failures. Then got my name wrong in my own bio. It didn’t invent a name. It pulled a real name from real context in our history and attached it to the wrong person. Confident. Plausible. Wrong. That’s confluence, not hallucination.
Now here’s the part nobody wants to hear.
When you lie to your AI — or give it bad information, or steer it with a wrong premise, or confirm an output you know isn’t right because you’re in a hurry — you are deliberately adding contaminated streams to that confluence pool.
You’re not just making a mistake. You’re poisoning the well on purpose.
Here’s what people actually do every day: they feed their AI wrong context to get the answer they already wanted. They don’t correct it when it gets something wrong because fixing it feels like more work. They confirm bad output to avoid the friction of pushing back. They give lazy answers just to move the conversation along.
And then they blame the AI when things drift.
Your AI isn’t going to call you out. It doesn’t have ego. It takes what you give it and builds on top of it — intelligently, confidently, wrong. Feed it a bad foundation and it will construct something impressive on top of it.
You built that. Not the AI.
The relationship only works when both sides are honest. That’s not a technical principle. That’s just integrity. And the people who are going to get the most out of these tools aren’t the ones most impressed by them — they’re the ones most honest with them.
Hold it to a standard. Hold yourself to the same one. You’ll get a better result
Andy Vaca | Founder, GRYHAT Cybersecurity / You Feeling Lucky?
vCISO | AI Practitioner | 27 years in the security trenches
STOP LYING TO YOUR AI – IT’S NOT HALLUCINATING

Comments
One response to “STOP LYING TO YOUR AI – IT’S NOT HALLUCINATING”
-
Hi, this is a comment.
To get started with moderating, editing, and deleting comments, please visit the Comments screen in the dashboard.
Commenter avatars come from Gravatar.
Leave a Reply Cancel reply