Lab 2: What Is Inside the 1,536 Numbers

An embedding model turns text into numbers that carry meaning. See the numbers — then find the meaning hiding in them.

1

Let a model do it — 1,536 numbers for any text

Type a word, then a sentence, then a whole paragraph. Count the numbers each time.

2

Where do words land?

Fifteen words from three groups, embedded, then squashed from 1,536 dimensions down to two so we can draw them. Add a word of your own and see where it falls.

3

Look inside: dimensions that mean something

Of the 1,536 numbers, which ones separate animals from vehicles? Find the six where the two groups disagree most.

4

Meaning you can do arithmetic on

If directions in the numbers mean something, you should be able to add and subtract them. Take king, remove man, add woman — what is nearest to the result?

āˆ’ + = ?candidates: