What Are LLM Parameters? A Model Is One Giant Function
A model is a function: numbers go in, numbers come out. The numbers that decide how it behaves are its parameters. On this page you turn the knobs (the parameters) yourself and watch the same box start doing a different job. At the end you see the results of an experiment that swaps the parameters of a real LLM.
- POINT 1A function is a box: a number goes in and a number comes out by a fixed rule. The same input always gives the same output.
- POINT 2The numbers that decide how a function behaves are its parameters. Change their values and the same box does a different job.
- POINT 3An LLM is one giant function defined by about 3.9 billion parameters. Their values and their places decide everything.
TRY 1
Turn the knobs and change the job of the box
The rule of this box is “output = a × input + b”. The two numbers a and b are its knobs (its parameters). Keep the formula as it is, change only the knob values, and make the box do three different jobs. You can drag a knob, use its slider, or press − and +.
output = 1 × input + 0
| input | target output | output now |
|---|---|---|
| 1 | 3 | 1 |
| 2 | 5 | 2 |
| 3 | 7 | 3 |
| 5 | 11 | 5 |
| 10 | 21 | 10 |
Turn the knobs until the output matches the target. 0 of 5 rows match so far.
The bars are the current outputs for the inputs in the table. A bar turns green when it matches its target. Everything is computed in your browser.
TRY 2
More knobs can describe more complicated relations
Make the light-blue line follow the orange dots. With 2 knobs you can only draw a straight line. With 4, and then 8, the line can follow a winding row of dots. Doing it by hand is hard, so there is a button that fits the knobs automatically.
With 2 knobs the best possible distance is 0.297. Turn the knobs, or press “Fit automatically”.
The line is k1 + k2·x + k3·x² + … “Fit automatically” computes the knob values with the smallest distance (least squares). For a real LLM, the work that corresponds to this button is called training.
TRY 3
Swap the parameters of a real LLM
A real model (Gemma 3 4B) has about 3.9 billion knobs. What happens to its output if not a single value is changed and only their places are swapped? Turn the knob to raise the share that is moved. Every candidate and every continuation was measured by actually running the model.
What the model wrote nextThe capital of France is Paris. ⏎ Paris is located in the north-central part of France
This is the original model. “Paris” is first with 85%, and the continuation is right. Turn the knob and move some parameters.
A few of the real parameters (there are 3,880,099,328 in all; the file is about 2.49 GB). All of them are small numbers close to zero.
- +0.01539
- −0.00377
- +0.00006
- −0.00377
- +0.01156
- −0.00760
- +0.00773
- −0.01143
- −0.00377
- −0.01143
- −0.02293
- +0.01156
- −0.01143
- +0.00389
- +0.00006
- +0.01922
- +0.01922
- +0.01539
- +0.01156
- −0.00377
- +0.00773
- −0.03826
- +0.01539
- −0.03826
The parameters are moved in blocks of 256 neighbours, to another place inside the same component (the result of one random draw). At the same share, how it breaks depends on which blocks are hit. That is why only one of the two sentences is broken at 0.3%.
CHECK
Check yourself
Three questions about what we learned today.
Q1What is a parameter?
Q2You feed the same sentence in twice. What about the next-token probabilities?
Q3All parameters keep their values but are moved to other places. What happens?
NEXT #8
The Full LLM Pipeline: Tokenization, Transformer, Generation
Next time we draw every step inside this giant function, from input to output, on a single map: tokenization, the Transformer, generation.
The candidates, probabilities and continuations in “Swap the parameters of a real LLM”, and the parameter values, were all measured on a real language model (Gemma 3 4B, 3,880,099,328 parameters). The results were computed in advance, so nothing is sent to a server. The knob calculations are done by your browser on the spot.