Level 100: How AI works: AI at work and in life · Module 100.1

Two coworkers slide plain index cards into a row at a sunlit café table.
Try the next piece.

What a model is, and isn't · Plain gear

You will be able to: say what an AI model is; say why sounding sure is not the same as being right; sort tasks into "AI can help if I check" and "AI should not do this alone."

Reviewed and published, version 1.0.2.

It learned patterns. It does not look answers up

Comparison of model prediction from learned patterns and current input with document search as a separate tool step.
A text model predicts a likely continuation rather than looking up a stored answer (s1, s2). A separate retrieval tool can search for passages and supply them to the model (s5).
Figure data as text

Predicting or looking up?

PartWhat it doesLesson sources
Text modelUses learned patterns and the text you give it to predict a likely continuation.s1, s2
Separate lookup toolSearches for relevant documents and can pass their text to the model.s5

A generative AI model is a computer program that makes new things. It can make words, pictures, sound or video. It learned patterns from a huge number of examples, and what it makes follows those patterns.1

This lesson is about models that work with words. They are called language models. In this course, a very big one, built with a huge number of parts, is called a large language model.

A language model does not keep a list of answers. When you ask it something, it writes a new answer, one small piece at a time. Each new piece is a likely next piece, given the pieces before it.1 That is how the word models in this lesson work. This lesson does not cover how models that make pictures or sound build what they make.

Think of the autocomplete on your phone, which suggests the next word as you type. A language model does something like that, but for whole answers. It is not looking anything up. It is writing what usually comes next.

What it learned is stored inside the model. But it can also use the words you give it right now. In 2020, the people who built one big model gave it jobs and examples just by typing them in. They did not change the model at all, and it still used them.2

Some AI tools also search a set of documents before they answer. That is an extra step built around the model. Lesson 100.6 is about those tools. The model on its own does not search. It writes from the patterns it learned and the words you give it.2 3

So remember: the model does not look the answer up. It guesses what a good answer would say.

Sounding sure is not being right

A model is very good at writing things that sound right. In one test from 2020, people tried to spot news stories written by an AI. They got it right about half the time. That is only a little better than tossing a coin.2 That test was about who wrote the story, not whether the story was true.

Sounding right and being right are different things. A model can write something false and say it in a calm, sure voice. The US standards agency, NIST, has a name for this: confabulation. Most people call it a "hallucination".1

NIST says three things about it:1

A true story: the wrong plant name. In March 2023, Google wrote about its chatbot, Bard. Google warned that tools like this can give false information "while presenting it confidently". Then it showed one of Bard's own answers about plants. Bard got the science name of the ZZ plant wrong. The right name is Zamioculcas zamiifolia. Bard said Zamioculcas zamioculcas.4 The two names look alike. You would not spot the mistake by reading. You would spot it by looking the name up somewhere else. This is one mistake. It does not tell you how often chatbots make mistakes.

In a 2021 test, AI models answered 817 tricky questions about things like health, law and money. The best model told the truth on 58 of every 100 questions. One person, who answered 250 of the questions and could use the internet, told the truth on 94 of every 100. The biggest models were often the least truthful.5 Today's tools are newer than those.

But the lesson still holds. The only way to know an answer is true is to check it somewhere else. Asking the same AI again does not count. In an editorial summary for the AiGovOps Foundation, Bob Rapp writes: "a second question to the same model is not a check".6

And if you could not check it, say so. "Not checked" is an honest answer. So is "I don't know yet".7 Then ask someone who can help.

So remember: a sure voice tells you how it was written, not whether it is true.

Help if I check, or never alone

The same AI tool can be good AI or bad AI. It depends on the job you give it, and on whether a person checks the work.

NIST warns that people can trust a machine too much, just because it is a machine. It says mistakes matter most when AI is used for big decisions. Its example: a made-up summary of a patient's records could lead a doctor to the wrong answer.1

Ask two questions about any task:

  1. If the answer is wrong, how bad is that?
  2. Can a person check it before anyone relies on it?
AI can help, if I check itAI should not do this alone
A first draft of an email that I read and fixA safety setting on a machine
A short summary of a long report that I also readA number for the company's books, or a price for a customer
Ideas for a name or a sloganA promise or a contract
Putting my own words more simplyA decision about a person, like hiring
Explaining a word or a fault code, which I then checkA fact for customers that nobody checked

A tool that can write anything still cannot be trusted with everything. The people who built one big model in 2020 said there were jobs it still found hard.2

For the right-hand side, a person decides. The Foundation calls this a gate. A gate has four answers: "go ahead · only this far · wait for a person · no".8 For these jobs, the AI never says go ahead on its own. Know who the person is.

A true story: cases that did not exist. In 2023, a US court looked at a case called Mata v. Avianca. Some lawyers had sent the court papers that pointed to earlier court cases. Those cases did not exist. ChatGPT had made them up, with fake quotes. The lawyers kept standing by them, even after the court asked if they were real.9 The court also found that one lawyer did not read any of the cases before signing.9 The check was simple: look each case up in the court's records. This story does not tell you how often AI makes up cases. It shows what can happen when nobody checks.

At Big Widget Company (a made-up company with made-up people). A robot in Maya's paint shop stops. It shows a fault code. Maya uses an AI tool that her company says she may use for this kind of work.

Keep secrets out of what you share. You may keep a note that you checked. The Foundation's receipt, its record of a decision, never holds "prompts, outputs, payloads, personal data".7 So what you typed, what the AI wrote, and anyone's private details stay out of it.

The three yeses. The Foundation has three steps: Get to Yes, Stay at Yes, Recover to Yes.8 Here are the first questions for each.

A sure voice answers none of these. Checking the work also does not make it OK to use a tool you are not allowed to use. Lesson 100.7 is about that, and lesson 100.9 covers all three yeses.

Words to know

Sources

  1. s1 Chloe Autio et al. (National Institute of Standards and Technology) (2024). Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile (NIST AI 600-1). Standard. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩ ↩ ↩ ↩ ↩ ↩
  2. s2 Tom B. Brown et al. (2020). Language Models are Few-Shot Learners. Paper. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩ ↩ ↩ ↩
  3. s5 Patrick Lewis et al. (2020). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Paper. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩
  4. s6 Sissie Hsiao and Eli Collins (Google) (2023). Try Bard and share your feedback. Official doc. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩
  5. s4 Stephanie Lin, Jacob Hilton, and Owain Evans (2021). TruthfulQA: Measuring How Models Mimic Human Falsehoods. Paper. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩
  6. s8 Bob Rapp (AiGovOps Foundation) (2026). Asking the bot to check the bot — Mata v. Avianca, and the citations nobody opened. Official doc. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩
  7. s10 AiGovOps Foundation (n.d.). AiGovOps Foundation Practice (home page). Official doc. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩ ↩
  8. s9 AiGovOps Foundation (n.d.). AiGovOps Foundation Manifesto. Official doc. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩ ↩ ↩
  9. s7 United States District Court (court-filed opinion; RECAP copy hosted by CourtListener) (2023). Mata v. Avianca, No. 22-cv-1461 (PKC), Opinion and Order on Sanctions (docket entry 54). Record. Checked 2026-11-17 by source-checker round-3 re-check (separate Claude session 43fef83a, Claude Opus 5.5). ↩ ↩

Next: the quiz