May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
AI Engineering · Why Production Breaks
Free preview: the first part of this 24-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Why Production Breaks
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Imagine you stay with a friend and she tells you how she likes her toast: "put the dial on 5". On her toaster the dial goes from 1 to 10, so 5 is the middle: golden brown. You go home, put bread in your own toaster and set its dial to 5. Your toaster's dial only goes from 1 to 6. On it, 5 is nearly the hottest setting.
A few minutes later the toast is black, smoke is coming out of the toaster, and the smoke alarm on the ceiling goes off. Someone is waving a towel at it while the person at the stove wonders what happened.

Notice what did not go wrong. Your friend's advice was right for her toaster. Your toaster worked perfectly. Nobody made a mistake in their own kitchen. The only problem was the number passed between them: 5 meant one thing where it was said and another thing where it was used. And the toaster did not complain. A toaster heats to the setting it is given.
A program that learned from examples behaves like that toaster. It was trained on numbers computed one way. When it is used, the numbers may be computed in a slightly different way, by different code. It does not refuse and it does not warn. It answers. In this lesson I measure how wrong those answers get, for six ordinary ways that the same number can be computed twice.