Lab 2: What Is Inside the 1,536 Numbers
An embedding model turns text into numbers that carry meaning. See the numbers ā then find the meaning hiding in them.
1
Let a model do it ā 1,536 numbers for any text
Type a word, then a sentence, then a whole paragraph. Count the numbers each time.
2
Where do words land?
Fifteen words from three groups, embedded, then squashed from 1,536 dimensions down to two so we can draw them. Add a word of your own and see where it falls.
3
Look inside: dimensions that mean something
Of the 1,536 numbers, which ones separate animals from vehicles? Find the six where the two groups disagree most.
4
Meaning you can do arithmetic on
If directions in the numbers mean something, you should be able to add and subtract them. Take king, remove man, add woman ā what is nearest to the result?
ā + = ?candidates: