May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
AI Engineering · Fine Tuning
Free preview: the first part of this 25-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Fine Tuning
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Think of a young football referee. She learned the job in one local league. The matches there were tidy: the same kind of teams, the same weather, the same small crowd, players who spoke her language. After a season she made almost every call correctly, and her coach was proud of her.
Then she is sent to referee a cup match far from home. The pitch is wet, the crowd is loud, two players shout at her in a language she does not know, and three things happen at once near the goal. Some of her calls are now harder. That is expected, and it tells her coach something useful: how good she is away from the matches she practised on.
Then something happens that the rule book simply does not cover. She checks the book, carefully, and finds nothing. A second referee, watching the same moment, makes the opposite call. Neither of them is careless. The book is missing a rule. No amount of practice fixes that. Only the league can fix it, by writing the rule down.

This lesson does the same to the two small models I trained in lesson 4. So far I have tested them on messages written in the same style as their training messages. Now I send them messages of six new kinds, and I compare them with two larger models that were only given the written rules. Both halves of the referee story happened: every model scored lower on the new messages, and one kind of message exposed a missing rule.