We use analytics cookies.We use cookies to analyze site traffic and improve your experience.
Loading...
AI Engineering · Tokens And Embeddings
Free preview: the first part of this 19-part lesson.
Already bought the course? Sign in to read the whole lesson.
this lesson is part of
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by PayPal
See the Generative AI and Agentic AI courseread the rest of this lesson in
Generative AI and Agentic AI Engineering
Unlock this lesson and the 208 other paid lessons
$35 once, by PayPal
See the Generative AI and Agentic AI coursein Tokens And Embeddings
This lesson is part of the AI Engineering course. Unlock the full course, a separate one-time payment, for lifetime access.
One-time payment by card or PayPal
Get Lifetime AccessOne-time payment: UPI, card or netbanking
Get Lifetime AccessFoundation lessons of this course are free, no payment needed. Try them now
I asked one question, "How do I stop one user from sending too many requests?", and scored one short text about against it. Same model, same two texts. One score came out as 0.741. The other came out as 521.380.

Neither number is wrong. They come from two different ways of comparing , used on vectors of two different lengths. Both words, vector and length, are explained on the next slide. This lesson is about which way to compare, and the one check that tells you whether the choice matters.

The two paper arrows point almost the same way, but one is much longer. A protractor reads direction, a tape measure reads size, and this lesson is about which of the two to use.

Both panels score the same pair with the same model: my rate-limiting text against one question. Cosine gives 0.741 from both endpoints, and a dot product on the old endpoint gives 521.380.