AI engineering · 31 of 42

Chain of Thought

Spend tokens thinking before answering

Scroll

Spend tokens thinking before answering

Rather than emitting an answer immediately, the model writes intermediate steps first. Each step lands in the context, so the next one can build on it.

It helps on problems with multiple dependent stages — arithmetic, constraint checking, anything where a wrong first move poisons everything after it. On simple lookups it changes nothing.

The reasoning is not hidden machinery. It is tokens: they cost money, take time and occupy the window, whether or not the interface shows them to you. Reasoning models make this the default, which is why their bills and their latency look so different from a chat model's.

Generation
SPEND TOKENS THINKING BEFORE ANSWERING a hard question straight to the answer an answer fast, and it guessed with intermediate steps restate it find the constraint check the edge case then answer each step is written into the context, so the next step can read it The reasoning is not hidden machinery — it is tokens, in the window, costing money and taking up room, whether or not you are shown them. It helps on multi-step problems and adds latency and cost to everything else.
The same question answered straight away, and answered after four visible intermediate steps.