May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
AI Engineering · Fine Tuning
Free preview: the first part of this 30-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Fine Tuning
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Think of a small team that answers customer letters. For years they have had one experienced person on the desk. She is very capable, but for this job she keeps a thick manual beside her and reads the relevant pages before she writes up each letter. She rarely gets things wrong, and she can handle almost anything, but reading the manual every time is slow.
Someone suggests a different plan: train a junior person on this one job, with hundreds of old letters and the right write-up for each, until the rules are in his habits and the manual can stay on the shelf. He would be quicker, and he would cost less. But training takes weeks, he has to be checked on letters he has never seen, and every time the rules change, he has to be trained again.

A sensible team would not decide this in a meeting by opinion. They would run a trial, put both people on the same letters, and compare. How often is each one right? What does each one cost per letter? What goes wrong, and how often? Then they would sit down with the results and decide.
This chapter has been that trial, with language models instead of people. This last lesson is the meeting. I take the chapter's stored results in the order a reader would actually make the decision, add the one measurement the chapter had not made yet, the cost of a single ticket, and say what the evidence supports.