Skip to content

Conversational AI

What is an AI hallucination?

An AI hallucination is a response from an AI system that sounds confident but is false, made up, or unsupported by its sources, such as an invented price, policy, or appointment time. It happens because language models generate plausible text rather than looking facts up. For a business assistant, a hallucination is a promise the business never made.

Why AI hallucinations happen

The US National Institute of Standards and Technology calls this risk confabulation in its Generative AI Profile (NIST AI 600-1): confidently stated but erroneous or false content. Models produce the most likely next words, and when the facts are missing, the most likely words can still be wrong.

For customer-facing assistants, the main causes are gaps in the knowledge base, outdated or conflicting sources, and instructions that reward always having an answer. The fixes are equally practical: answer only from approved sources, say when information isn’t available, list promises the assistant must never make, and send uncertain questions to a person.

Illustrative example

Example: an invented delivery fee

A party rental company’s chatbot is asked whether delivery to a nearby town is free. Its knowledge lists delivery fees only for the home city. An unguarded bot answers “Yes, delivery is free within 30 miles,” a policy the company never had. A guarded assistant says it doesn’t have the delivery fee for that town and asks the owner to confirm. This scenario is illustrative.

How InsertChat guards against hallucinations

InsertChat’s assistant is instructed never to invent business facts, prices, policies, availability, or commitments, and to say so when information is missing or conflicting; that setting can’t be turned off. You can list promises or decisions it must not make, and by default it asks a person for help when an answer is uncertain.

On calls, it waits for a verified result before saying anything was booked. Knowledge gaps in knowledge and answers show which real questions need better sources. See the party rental setup.

Related InsertChat pages

Sources

Related terms

Full glossary ↗

AI hallucination: common questions

Plain answers for small businesses

Not entirely with today’s models. They can be made rare with grounded answers, clear instructions to admit gaps, testing, and human handoff for uncertain questions.

Customers generally treat the chatbot as speaking for the business. That is why businesses should limit what it can promise and review conversations regularly.

Facts last reviewed .

Build your AI front desk.

Start with the questions you answer every day.

Add your business information, test the answers, and connect your first customer channel.