How to tell which work is worth handing to an agent
Four things you can do with a task, three questions in the order that decides, and why the shape that looks worst is usually the one to augment.
There are four things you can do with a task, not two.
What you are buying is not the doing. It is the doing minus what it takes to find out whether the result is right — and that second cost is the one that did not fall, because checking needs somebody who knows the domain well enough to recognize a wrong answer.
Which means the decision is not automate-or-not. It is one of four, and how cheaply you can check the result decides which. This volume is twelve short steps on getting that assignment right. It assumes you have read nothing else in this series.
The four
| the disposition | what it means |
|---|---|
| automate | the agent does it, and you check the result cheaply — or a machine does |
| augment | the person keeps doing it and the agent helps; the checking rides along with the doing |
| remove | the step should not exist. Automating it would make the workflow permanent |
| leave alone | none of the above is worth the change. The default, and it needs saying |
The most common wrong answer in this subject is no given to a task that should have been augmented. High volume and expensive checking looks like the worst possible candidate, and it usually means the person should keep doing the work with the agent helping — because then nobody has to rebuild the context, and the checking cost does not arise at all rather than merely shrinking.
And the highest-leverage page is not about agents. Some steps on your list should not exist. Automating one of those makes it permanent, because now a schedule and a downstream job depend on it — so it becomes harder to delete than it was when somebody was doing it grudgingly by hand.
What you can do afterward
Read a proposal for the cost it left out. Ask the one question that gets you that cost. Assign one of four words to every candidate on your list and defend it. And add four lines to any proposal you are handed, answerable by people already in the room.
The four dispositions, the three questions and the four missing costs are on one page you can print.
Every term this page uses
- disposition
- Which of the four things you are going to do with a particular task: automate, augment, remove, or leave alone.
- augmentation
- The person keeps doing the work and the agent helps. The checking rides along with the doing rather than happening afterward, by somebody else.
- checking cost
- What it takes to find out whether a result is right. The cost proposals leave out, and the one that did not fall.
- reach
- How much is affected when the answer is wrong.
- detection delay
- How long before anybody notices a wrong answer. Multiplied by reach, this is the risk.
- drift
- The slow way an automated thing stops matching the world around it, without ever breaking.
- kill condition
- The result, stated in advance, that ends a trial. Without one a trial does not end — it stops being discussed.
- maintenance
- The standing cost of keeping an automated thing working after it is built.
Taken as already known, and so not defined here: agent, model, task, queue, proposal. That list is a claim about who is reading, and it is printed so it can be argued with.