May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
AI Engineering · Ml Lifecycle
Free preview: the first part of this 22-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Ml Lifecycle
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Imagine you give a friend a shopping list and a recipe, and ask them to cook the same dinner on Monday and again on Tuesday. Same shop, same list, same recipe. You would expect the same dinner. But the shop has a rule you never read: at the door, one bag in every ten is taken aside at random for a quality check, and it never comes home. On Monday the missing bag held the onions. On Tuesday it held half the rice. Your friend followed the recipe exactly both times, and the two dinners taste different.

Nobody in that story made a mistake. Nobody changed the list. The difference came from a rule that was switched on by default, and that picked something at random every time. If Tuesday's dinner is worse, you cannot find out why by reading the recipe, because the recipe did not change.
This lesson is about the same thing in a computer program that learns from examples. I trained one program 20 times with the same code on the same data and got 20 different programs out. Their scores on the future ran from 0.7179 to 0.7906. The reason was one setting I never wrote, left at its default value, which set aside a random tenth of the examples every time. The rest of the lesson finds that setting, measures what it does, and shows what to write down so that a run can be repeated exactly, and why, even then, one run is not enough to say that one program is better than another.