May we use cookies so Meta, Google, LinkedIn and ChatGPT see your visit and we learn which ads work? PrivacyMay we use cookies to see which pages help, and let Meta, Google, LinkedIn and ChatGPT see your visit, so we know which of our ads work? That way we spend less on ads that do not work. We do not sell your data, and the site works the same if you decline. You can change your answer at any time under Cookie settings at the foot of the page. Privacy policy
Loading...
AI Engineering · Features And Feature Stores
Free preview: the first 2 parts of this 26-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by card or PayPal
See the Generative AI and Agentic AI coursein Features And Feature Stores
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
Let me start with a teacher and her mark book.
Last term, she took one point off for every careless slip. This term, the school changed the rule: careless slips no longer cost anything. Nothing else changed. Same students, same kind of tests, same mark book. And in that book, both terms' marks sit in one column, called "mark".

Now think about what can go wrong. A head teacher compares this term's marks with last term's and says the class improved. Did it? Partly, maybe. But part of the rise is only the new rule. A scholarship committee ranks students using marks from both terms together. A student who did well last term is now compared with students marked by a kinder rule.
The teacher could fix this in a few ways. She could re-mark every old paper with the new rule. That is a lot of work. She could re-mark only the last few weeks. She could write "old rule" and "new rule" next to each mark, so at least everyone can see the difference. Or she could do nothing and hope it does not matter.
Machine learning has exactly this problem. In this lesson I measure each of those choices on real data.
This lesson uses the same shop, customers and question as the rest of the chapter. If any of that is new, please read what a feature is first. That lesson built six features from each customer's history: recency, frequency, money, return share, tenure and products. The question is always the same. At the start of a month, will this customer buy something in the next 30 days?
Two definitions from that lesson matter here. Money was net spend: every line added up, and since the shop records a return as a negative amount, returns are taken away. Frequency was the number of separate purchase invoices.
In the lesson on online and offline consistency, one serving choice was to read "money" as purchases only and leave returns out. That lesson measured what happened when only the serving side did this. Here I go further. I treat it as a deliberate change of definition, and ask what happens when you retrain, backfill half the history, or keep the old name.
Two other lessons are close to this one, and I do not repeat them. Data versioning is about keeping the exact raw data that trained a model. Data contracts is about a producer changing the shape or meaning of the records it sends. This lesson is about something narrower: one feature's definition changing, while the raw data stays exactly the same.