The Next TokenLearnBookArchive
Saved

Interactive · the full journey

From your sentence to a prediction.

Pick a sentence and watch the same words travel all four steps, the trip your words make every time you talk to an AI.

Pick a sentence

I love eating apples in the morning ___

First, the sentence is chopped into the chunks the model recognises. A · marks a space inside a token.

Each meaningful word becomes a point in space. Tap one to see its nearest neighbours in this sentence.

Before writing the next word, the model checks which earlier words matter. Tap a word to see what it leans on.

Finally it ranks the next word and bets on one. Drag the temperature dial to see safe versus adventurous.

Temperature0.80

balanced

·and
31%most likely
·before
15%
.
17%
·every
12%
·with
11%
·on
7%
·because
7%longshot

That is the whole trip. No thinking, no understanding the way you do it. Just chunks, coordinates, context, and a bet on the next word, repeated fast enough to feel like magic.


Just Predicting Words book cover

The book behind this newsletter

Just Predicting Words

How ChatGPT, Claude, and Modern AI Actually Work

The trick is small. The world it built is not.

PaperbackKindleAudiobook · SpotifyAudiobook · Google Play