May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
AI Engineering · Ml Lifecycle
Free preview: the first part of this 26-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Ml Lifecycle
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Imagine a small town that hires a weather forecaster. Every evening she studies the clouds, the wind and the pressure, and writes her forecast for tomorrow on a board in the square. She is proud of her record: she is right seven days out of ten.
Now imagine her neighbour, who knows nothing about weather. Every evening he writes the same thing on a card in his window: "Tomorrow will be like today." If it was dry today, he says dry. If it rained, he says rain. He never looks at a cloud. And because weather tends to last for a few days at a time, he is right more often than you would think. In some towns he would be right more often than she is.

Her seven days out of ten sounds good on its own. It only means something next to his number. If he is right eight days out of ten, all her study has made the forecast worse, not better, and the town would do well to read his card.
This lesson does the same thing to programs that learn from examples. Before I trust a trained model's score, I score the laziest rules I can think of, on the same test, the same way. On the data in this lesson, the laziest rule of all won, and a shuffled test would have hidden that.