May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
This idea carries a full system design question on its own. Each walks through the full answer.
AI Engineering · Ml Lifecycle
Free preview: the first part of this 28-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Ml Lifecycle
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Imagine a school with an old piano in its hall. A piano slowly goes out of tune: the strings stretch a little every week, the room gets warmer and colder, and children play it hard. Nobody notices one week's change. After a few months, everyone notices.
The school has two ways to decide when to call the tuner. The first is a calendar: the tuner comes on the first Monday of every month, whether the piano needs it or not. That costs money every month, and some visits are wasted, but the piano is never out of tune for long.
The second way is to listen. The caretaker plays a short tune every Friday and calls the tuner only when it sounds clearly worse. That sounds smarter, because the school pays only when there is a problem. But the caretaker has to decide what "worse" means. Worse than what? He decides to compare each Friday with the first Friday after the last tuning.

Now suppose one tuner does a poor job, on a damp week, and the piano already sounds bad on the first Friday after. From then on, the caretaker compares every Friday with that bad Friday. The piano never sounds much worse than that, so he never calls anyone again. The rule looked careful. It was anchored to a bad day: tied to one starting point that happened to be poor.
This lesson is about the same decision for a program that learns from examples. I tried both ways, a calendar and a listening rule, on real data, and the listening rule failed in this same way.