AI Is LYING About Your Business

JessiPinkme

Elite Member
Jr. VIP
Joined
Feb 24, 2019
Messages
5,251
Reaction score
1,535
Found this on reddit. Its an interesting take for local SEO.

I asked ChatGPT, Claude, and Gemini the exact same question about a local business, and they all gave me a different answer. I asked: “Does Texas Coffee Traders Cafe offer sugar-free drinks?”

Here are the results:

  • ChatGPT found sugar-free vanilla syrup.
  • Claude said it could not find any specific mention of sugar-free options.
  • Gemini said the cafe offers sugar-free flavor alternatives.
So which one is correct? ¯\(ツ)

A service you offer might be clearly mentioned on your website but missing from your Google Business Profile, buried in an old social post, listed only on a menu platform, or mentioned in reviews but nowhere else.

That is why you should regularly ask multiple AI tools what they know about your business. Pay attention to two things:

  1. What information do they get wrong or leave out?
  2. Which sources are they citing?
Those cited sources are places where your business information needs to be accurate, clear, and up to date.

Your website and Google Business Profile still matter, but so do your menus, social profiles, review sites, directories, and every other platform AI may use to understand your business.

 
AI is not smart enough to lie. It's a parrot that reproduces information and restructures it to match user intent. The only intelligence in AI is information chunking that allows them to form answers that suits the user's query. So, if there's any misinformation, it's most likely mentioned somewhere and AI just picked it up.
 
I watched a post regarding why AI answers are different everytime.
He explained that AI averages the answers i.e. it averages the results available on the internet and then replies. And for AI, the results are always varying so the average always kept on changing.
From the math point of view it made sense to me. IDK how much it will to others though.
 
AI is not smart enough to lie. It's a parrot that reproduces information and restructures it to match user intent. The only intelligence in AI is information chunking that allows them to form answers that suits the user's query. So, if there's any misinformation, it's most likely mentioned somewhere and AI just picked it up.
Totally agree. Ai is basically a parrot who picks up misinformation sometimes. It's designed to do so.
 
The "lying" framing is off - it's not inventing anything, it's a retrieval difference. ChatGPT and Gemini were grounding on live search and hit different sources, so different answers. Claude without browsing just answered from training and said it couldn't confirm - which is the honest reply when there's no live source in front of it. Three retrieval paths, three answers, not three truths.

And it's not "averaging the whole internet" - it's whatever source gets retrieved and ranked highest for that query.

So the fix isn't asking AI on repeat, it's controlling what it pulls from: clean GBP attributes (Google has a sugar-free / dietary set), schema on your site, consistent info across menus and directories. Clean the machine-readable data and the models converge. The disagreement is just a symptom of scattered info.
 
Back
Top