May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
AI Engineering · Features And Feature Stores
Free preview: the first 2 parts of this 27-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Features And Feature Stores
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Let me start in a classroom.
A teacher has a pile of tests to mark. Most students wrote full answers. One sheet is almost empty. Maybe the student joined the class last week and has not learned the topic yet. Maybe the student wrote a full page, and the page got lost on the way to the teacher's desk. Either way, the end-of-term ranking needs a mark for every student, so the teacher must write something in the book.

What mark should the empty sheet get? There are only a few sensible choices. A zero says "this student knows nothing", which is unfair if the page was lost. The class average says "this student is ordinary", which may or may not be true. A special mark, like "no paper", says "I do not know", and lets the teacher treat that student differently later.
None of these choices is obviously right. And the choice matters most when many sheets are blank at once.
Machine learning systems face the same question every day, many thousands of times. In this lesson I measure the choices on real data from a real shop.
This lesson uses the same shop, the same customers and the same question as the rest of the chapter. If any of that is new, please read what a feature is first. That lesson built six simple features from each customer's history: recency, frequency, money, return share, tenure and products. The question is always the same: at the start of a month, will this customer buy something in the next 30 days?
The lesson on feature freshness found something I promised to come back to. When the feature job runs 30 days late, 716 of the 26,851 test customers have no feature row at all. They are real customers who first appeared in the shop during those 30 days, so the job never saw them. That lesson simply left their features empty and moved on.
This lesson asks the question that lesson skipped. When a customer's features are missing at the moment the model is asked, what should the service put there instead? And does it matter how the model was trained?