What an agent actually is
A chatbot answers a question. An agent pursues an outcome. The difference is not intelligence — it's a loop and a set of hands.
- You can name the four parts every agent has, and say which one is missing when something "isn't really an agent".
- You can place any product you've heard of on a six-level autonomy ladder, from tool to self-improving.
Ask a chatbot "what's the cheapest flight to Chicago on Thursday?" and you get a confident paragraph, some prices it may have invented, and a link to go check yourself. Ask an agent the same thing and it opens a browser, searches three sites, compares the results, notices the 6am is cheaper but leaves you 12 minutes to connect, books the 8am, and puts the confirmation in your calendar — then tells you what it did.
Nothing magical happened in the second case. The same kind of model was used. What changed is that the model was wrapped in a loop, given tools, and allowed to keep state across steps. That wrapper is the whole discipline.
1.1The four parts
Strip away the branding and every agent — a coding assistant, a support bot that issues refunds, a research assistant that reads forty papers — is the same four-part machine.
"Agent" is now a marketing word. If a product cannot take an action in the world and cannot recover from a failed action, it is a chat interface with a nice prompt. That is fine — it's just not an agent, and it will not do your taxes.
1.2The autonomy ladder
Autonomy is not one switch. It's a dial with recognisable stops, adapted from the same six-level scale used for self-driving cars. Drag the dial and notice what the human's job becomes at each level — that job is the real product decision.
L0 · Tool
One function call. No memory, no decisions. A spell-checker. A summarize button.
HUMAN ROLE: operator · "I press the button."
L1 · Chain
A fixed sequence of calls, wired in advance. Extract → translate → format. Predictable, cheap, and easy to debug.
HUMAN ROLE: supervisor · "I built the sequence."
L2 · Router
The model chooses among known paths: "this is a refund request, send it to the refund flow." Most customer-facing "AI agents" in production today sit here.
HUMAN ROLE: monitor · "I watch the distribution of decisions."
L3 · Planner
The model writes a multi-step plan, then executes it step by step. This is where real agent capability begins — and where cost, loops and unpredictability begin too.
HUMAN ROLE: approver · "I sign off on plans and risky actions."
L4 · Autonomous agent
Plans, executes, adapts, and recovers from failure without asking. Runs for hours. Needs permissions, budgets, checkpoints and an audit trail to be safe.
HUMAN ROLE: on-call · "I get paged when it's stuck or out of budget."
L5 · Self-improving
Modifies its own prompts, tools or code based on results. Largely research. Treat any product claiming this with friendly scepticism.
HUMAN ROLE: governor · "I set the constraints it may not edit."
Practical rule: most reliable production systems are L2–L3 with strong guardrails. L4 exists; L5 is mostly a pitch deck.
1.3Where the line sits
| You have… | It can | It cannot | Typical build time |
|---|---|---|---|
| Prompt | Transform text you paste in | Look anything up, remember anything, act | Minutes |
| Chain | Run a fixed pipeline | Choose a different path when something is odd | An afternoon |
| RAG system | Answer from your documents, with citations | Decide to do something about the answer | A few days |
| Agent | Choose steps, call tools, check results, retry, report | Be trusted blindly — it needs permissions and review | A week to a quarter |
Notice the build-time column. Every step up the ladder multiplies the number of ways the system can surprise you. That is why the honest advice, in every module after this one, is the same: build the simplest thing that could possibly work, then add agency only where it earns its keep.
Write down one task you did this week that felt repetitive. Then answer three questions: (1) What would "done" look like, as a checklist? (2) What tools would something need to touch — files, web, email, a database? (3) What is the worst thing that happens if it acts wrongly once?
Keep that note. It is the raw material for the challenges at the end, and it is a better starting point than any tutorial you'll find.
A product lets you upload a PDF and answers questions about it in polished prose. Which part is missing before you could call it an agent?
60-second recap
- An agent = model + goal + tools + state, held together by a loop. Remove any one and you have a chatbot, a script, or a demo.
- Autonomy is a dial, not a badge. L2–L3 is where dependable systems live; each level up buys capability and costs predictability.
- The wrapper is the engineering. The model is interchangeable; the goal definition, tool design, state handling and permission model are yours.