Self-Learning Agents Concepts › What a self-learning agent writes down 12 of 12 steps written
01 — part 1, conceptsconcept

What a self-learning agent writes down

Self-learning engineering is the practice of deciding what an agent may conclude from its own attempts, and what has to be true before it is allowed to act on that conclusion.

The definition

A self-learned rule is a policy the agent wrote from its own attempt, and reads on a later attempt. Two halves, and both are load-bearing. The agent wrote it — nobody reviewed it. And it is a policy rather than a record: it says what to do, not what happened.

Four things it is not

The word "learning" carries a great deal of freight, and three of the four things it usually means are not this subject.

what it changesis it this volume?
training, fine-tuningthe weightsno — you are not running gradient descent in a loop
a transcriptnothing; it is a recordingno — nothing in it claims how to act
a memorya record of what was trueno — a memory makes a claim about the world
a self-learned rulewhat the agent will do next timeyes

The distinction from memory is the one worth being careful about, because the machinery looks identical — something is written in one attempt and read in a later one. A memory says the cap is 180. A rule says fold unicode before comparing. The first can be checked against the world; the second can only be checked against outcomes, and the whole of Part 2 is about what happens when the outcome you check against is the wrong one.

The shape of the loop

attempt one step 1 step 2 step 3 failed the rule book written by the agent reviewed by nobody a policy, not a record it says what to do next time attempt two step 1 step 2 step 3 carried in and every attempt after this one a wrong rule is wrong in the same direction, every time
The first attempt fails and a rule falls out of it into the book. The second attempt pauses at the book, picks the rule up and carries it into its own steps — and so does every attempt after that. Nothing reviewed the rule on its way in.
Nothing in this scene is measured. It is the mechanism; step 4 prices it.

Steps 2 and 3 are where the subject lives. Step 4 is where most of the engineering effort goes, and step 2 is where the result is decided.

Why the rule is the dangerous artifact

A wrong memory makes one answer wrong. A wrong rule makes every later attempt wrong, in the same direction, and it does it while looking like progress. That is the asymmetry that makes this worth a volume: the artifact is small, cheap to produce, and applies to everything after it.