Understanding AILesson 4/8

Lesson 4 of 8 · 12 min

When AI gets it wrong

Made-up answers, outdated information, bias: how to recognize them and check.

An assistant always writes with the same confidence, whether it is right or wrong. That is what makes its mistakes dangerous: nothing in the tone warns you. This lesson teaches you to recognize the main kinds of errors and to check what matters, in a few minutes.

Made-up answers

This is the best-known error. When information is missing, the assistant can produce a plausible but false answer: a precise figure, a quote, a book title, a section of a law, a scientific reference that does not exist. This is often called a “hallucination”.

It follows directly from what you saw in lesson 2: it predicts a likely continuation, it does not consult a database. A fake reference that is nicely formatted looks a lot like a real one.

Out-of-date information

What an assistant learned stops at a certain date. It may therefore not know about a new law, a price change, a sports result or someone newly appointed to a position, and present the old situation as if it were current.

Some assistants run a web search to fill the gap. Check whether it shows sources: if it does not, assume the answer may be out of date.

Bias

The assistant learned from texts written by people, with their prejudices. It can reproduce stereotypes (imagining that a doctor is a man and a nurse a woman), favor one cultural point of view, or present as obvious something that is debatable.

To spot them, ask yourself: would the answer have been the same for another person, another country, another background? Feel free to ask “What other points of view exist on this question?”.

Calculation and logic errors

An assistant is built for language, not for counting. It can get an addition, a percentage, a conversion or a multi-step reasoning wrong. For a calculation that matters, use a calculator or a spreadsheet, or ask it to show each step so you can check them.

How to check, simply

You do not need to check everything. Focus on what will be used, published or decided.

  1. Ask for the source. “Where does this figure come from? Give me the exact source.”
  2. Open the source yourself. A link may not exist, or may not say what the assistant claims.
  3. Cross-check with a reliable source: an official website, a public agency, a recognized news outlet, a professional.
  4. Test it on what you know. Ask the assistant about your city or your job: you will quickly see how reliable it is.

When to be especially careful

For health, law, money and any important decision, the assistant can help you understand, prepare your questions or summarize a document. But the decision must rely on a reliable source or a professional: doctor, pharmacist, lawyer, notary, accountant.

Key takeaways

  • An assistant can make up figures, quotes and references with confidence.
  • Its knowledge can be out of date, and its answers can reflect biases.
  • It is built for language, not for exact calculations.
  • Check first what will be used, published or decided.
  • Ask for the source, open it, cross-check it.

Quiz

1. Where do made-up answers most often hide?
2. The assistant gives you the current price of a service, with no source. What should you think?
3. You want to check an important claim. What is the best method?
4. For an important budget calculation, what do you do?
Next lesson: Privacy and security
Next