Next-word guesser
A 5 MB language model suggesting your next word, running entirely in this page.
Model view: which neurons light up
The model at the last whole token before the cursor. Each row is a layer: its 5 attention heads (darker = more focused; click one to see what it looks at, highlighted in the tokens), its 448 neurons (orange fires positive, blue negative, scaled per layer; hover for details), and what the model would guess if it stopped after that layer.
Tap a suggestion, or press Tab for the first. Suggestions complete a half-typed word, or guess the next one after a space. Continue (Ctrl+Enter) writes on from the cursor. Heat sets how bold it is: low picks the likeliest words, high takes chances. It changes what's written much more than the suggestions, which are always the likeliest few.