weakestlink

← All courses

Nano-lesson · usually takes 2–3 minutes

AI suggests, you decide

The danger isn't that AI gets it wrong. It's that no one takes the time to check.

When the draft becomes the decision

It starts sensibly enough: AI produces a draft, you read it through, you make corrections. But when the drafts keep being good enough, you stop reading. This is called automation blindness, and it's the real risk — not that the machine fails, but that no one is looking any more. It's not just about text: if you always follow the system's suggestion — a route, a picking list, a dosage — without pausing when something looks wrong, you're in the same place.

Hold on to three things

  • A draft is a draft. Your signature is yours, even when the text came from somewhere else.
  • Read it as if a colleague had written it. Would you forward a colleague's draft without reading it?
  • Speak up when it can't be checked. If you're set to approve a hundred suggestions an hour, you can't approve any of them properly. That's information your manager needs.

Especially when it's about people

When something has to be decided about a person — a hiring, a complaint, a benefit — the decision must never rest with the machine alone. A human has to be involved who can genuinely change the outcome, not just press approve.

Remember

AI may prepare. The human decides.

What the research says

In hospitals, researchers have studied the systems that suggest to the doctor or nurse what should be done. When the system suggested something incorrect, the risk of a wrong decision rose by 26% — experienced people changed their own correct answer to the wrong one because the screen said something different. This isn't stupidity. It's what happens when something has been right many times in a row.

Goddard et al., JAMIA 2012 (systematic review).

Question 1 of 3

You've approved 40 AI drafts in a row, and they were all good. What's the biggest risk now?

Question 2 of 3

When is "a human looks at it" not genuine oversight?

Question 3 of 3

You're told to approve more cases than you can manage to read. What's the right thing to do?

Well done!

You've completed one of the foundation courses — the ones everyone gets for free.

With a free login:

  • Your points, progress and course certificate are saved.
  • You get courses tailored to your role — not just the foundation courses.
  • We send training exactly when you need it — for example, as a follow-up to a phishing test.