Multi-agent AI explained: why a crew can beat a single bot
Multi-agent AI explained: how a lead agent delegates, why a skeptic that checks the work matters, what it costs, and how crewAI and LangGraph do it.
On this page
Picture a one-person business where the owner researches a market, crunches the numbers, writes the report and proofreads it, all in one sitting. It gets done, slowly, and the mistakes survive, because nobody checks your work as poorly as you do. Companies split work into roles for good reasons: focus, speed, and someone else looking it over. Multi-agent AI applies the same idea to AI agents. Instead of one bot doing everything, a team of agents shares the job: a lead that plans and delegates, specialists that do the parts, and a reviewer that checks what they found.
This guide explains how that works, when a crew really does beat a single bot, what it costs, and how the open frameworks (crewAI, AutoGen, LangGraph) approach it.
What is multi-agent AI?
Multi-agent AI is a system where several AI agents, each with its own instructions, tools and working memory, handle different parts of a job and pass results between them. Usually one agent leads: it breaks the goal down, hands out the pieces and puts the answers together.
If "agent" is new to you, start with what is an AI agent?. In short, each agent is a language model running in a loop with tools. A multi-agent system runs several of those loops and connects them.
A typical crew has three kinds of roles:
- A lead (also called an orchestrator or manager) plans the job, decides who does what, and judges the results.
- Specialists (also called workers or sub-agents) each take one piece: research, finance, the inbox, a server.
- A reviewer (a critic, verifier or skeptic) checks the specialists' findings before anyone acts on them.
Why a crew can beat a single bot
1. Focus: a clean desk for every task
An agent can only use what fits in its context window, the text the model sees on each step. Stuff it with everything and quality drops: Anthropic describes "context rot," where the model's ability to recall information falls as the context grows. A specialist gets a short brief and only the material for its part, so it works with a clear head.
2. Speed: work in parallel
A single agent works one step at a time. A lead can send several specialists off at once. Anthropic built its research feature this way: a lead agent plans, then sub-agents search in parallel, each with its own context window, and report back. On Anthropic's internal research evaluation, that multi-agent setup outperformed a single agent by 90.2%.
3. Specialists: fewer tools, better choices
Give one agent lots of similar tools and it starts picking the wrong one. OpenAI's guide notes that some agents handle more than 15 well-defined tools while others struggle with fewer than 10 that overlap, and suggests splitting the work across agents when clearer tool descriptions don't fix it. A finance specialist with a handful of distinct finance tools has far fewer ways to choose wrong than a generalist with forty. Each seat can also run on a different model: a strong one for hard judgment, a cheaper one for routine sorting.
4. A second opinion: checking beats more doing
This is the underrated one. A 2023 study had several copies of a model propose answers and then critique each other over a few rounds; the debate improved reasoning and reduced factual errors and hallucinations. And in April 2026 Cognition, which builds the coding agent Devin, reported that among the multi-agent setups it had tried, a maker-and-checker loop works well in practice, with the reviewer doing notably better when it starts from a clean context rather than inheriting the maker's assumptions.
The skeptic: why every crew needs a critic
Specialists are optimistic. They found an answer, and the pull is to report it. A skeptic's whole job is to attack that answer before it reaches you:
- Is there evidence for the claim, or did the specialist infer it?
- Does the number add up if you check it another way?
- Was the obvious alternative ruled out?
Here's a small example. A finance specialist reports: "Three clients are more than 30 days late." The skeptic checks the bank feed and finds that one of them paid yesterday; the payment just hasn't been matched to the invoice yet. You get "two clients are late, and one payment needs matching" instead of an awkward reminder to someone who's paid.
The skeptic works because it doesn't share the specialist's train of thought. Same evidence, fresh eyes, opposite incentive.
Common multi-agent patterns
| Pattern | How it works | Good for | Watch out for |
|---|---|---|---|
| Lead and specialists | A lead plans, hands pieces to specialists, combines results | Research, multi-part business jobs | The lead must brief each specialist clearly |
| Handoffs | Agents pass the whole job to whichever peer suits the next part | Customer service triage | Context can get lost at each handover |
| Pipeline | Each agent does one stage and passes its output on | Draft, then edit, then format | One weak stage spoils everything after it |
| Maker and checker | One agent produces, another reviews, they iterate | Code, analysis, facts and figures | Extra rounds cost extra |
| Debate | Several agents answer, critique each other and converge | Hard questions with a checkable answer | Several agents over several rounds adds up fast |
OpenAI's guide calls the first two the manager pattern (other agents used as tools by a central manager) and the decentralized pattern (peers handing off to one another). crewAI offers the pipeline as its sequential process and the lead-and-specialists model as its hierarchical process, where a manager agent plans, delegates and reviews the outputs.
The trade-offs nobody puts on the slide
Multi-agent AI isn't free, and it isn't always better.
It costs more. Anthropic measured that its multi-agent systems use about fifteen times as many tokens as a chat, against about four times for a single agent. Its advice: use them where the value of the task pays for the extra performance.
Coordination is hard. Anthropic found that without detailed task descriptions, sub-agents "duplicate work, leave gaps, or fail to find necessary information." In one case, a sub-agent researched the 2021 car-chip shortage while two others duplicated each other's work on 2025 supply chains. It also notes that agents are "not yet great at coordinating and delegating to other agents in real time."
Decisions can clash. In a June 2025 essay titled "Don't Build Multi-Agents," Cognition's Walden Yan described splitting a Flappy Bird clone between two sub-agents: one drew a background in the style of Super Mario Bros., the other a bird that looked and moved nothing like Flappy Bird's, leaving the final agent with pieces that didn't fit. Every action carries hidden decisions, and parallel agents make different ones. In its 2026 follow-up, Cognition says having several agents write changes in parallel still doesn't work well.
Many systems fail in predictable ways. A 2025 study of multi-agent frameworks found their gains on popular benchmarks were often minimal, and catalogued 14 failure modes in three groups: how the system was designed, agents misunderstanding each other, and weak checking of the final result.
Some jobs don't split. Anthropic says tasks where every agent needs the same context are a poor fit today, and that most coding tasks have fewer truly parallel parts than research does.
When a crew beats a single bot (and when it doesn't)
Use a crew when:
- The job splits into parts that can be done independently: research five suppliers, check three systems.
- The parts need different tools or access, and you'd rather no single agent had all of it.
- A mistake would be costly enough to deserve a second pair of eyes.
- The job is valuable enough to pay for the extra tokens.
Use a single agent when:
- Each step depends tightly on the one before.
- One line of decisions has to stay consistent, like a single document or a single code change.
- The job is small and cheap, and speed matters more than a review.
OpenAI's guide gives the sensible default: get the most out of a single agent first, and split only when it starts choosing the wrong tools or tripping over complicated instructions. Cognition's 2026 rule of thumb is a good compromise: one writer, many readers. Let several agents research, advise and check, but let one make the changes.
Open frameworks: crewAI, AutoGen and LangGraph
If you're a developer building your own multi-agent system, three names come up most. Here's what each one is, from its own documentation.
| Framework | From | What it is | How it organises agents |
|---|---|---|---|
| crewAI | crewAI (open source, MIT licence) | A standalone Python framework for orchestrating role-playing agents | Agents defined by a role, a goal and a backstory, working in Crews; Flows wrap them in event-driven workflows; sequential or hierarchical (manager-led) processes |
| AutoGen | Microsoft Research (open source, MIT licence) | A framework for multi-agent applications that act alone or alongside people | Agents that exchange messages to complete tasks (multi-agent conversation). Now archived: Microsoft points new users to Microsoft Agent Framework, its successor |
| LangGraph | LangChain | A low-level orchestration framework and runtime for long-running, stateful agents | Steps and agents as a graph, with saved state, pauses for a person to review, and memory |
A few notes. Microsoft Agent Framework combines AutoGen's agent abstractions with Semantic Kernel's enterprise features and adds graph-based workflows; it supports .NET, Python and Go. LangGraph deliberately doesn't prescribe an agent architecture: you design the graph. And crewAI is the closest in spirit to a human team, with agents described like job roles. If you're weighing crewAI against a ready-made crew, see crew bot vs crewAI.
All three are for people who write code and run their own infrastructure. That's the right choice if you want full control and have engineers to spend on it.
How crew bot's crew works
crew bot is the product version of this idea, for a business that wants the crew without building one. You hand a job to the Lead, on the board or from Telegram with text, voice notes or photos. The Lead plans the job and splits it between specialists who work at the same time. A skeptic attacks every finding before it reaches you. Each seat uses the model that fits it, from several AI labs, so the crew is never locked to one. And the crew remembers how you like things done ("big orders over $500 need a deposit first"), so you explain a job once.
The same rules apply to the whole crew, however many agents a job uses: it asks before anything that writes unless you've told it to go ahead, every job has a budget (fifty US cents by default, after which it stops and asks), and every step is on record. Teams add members and approval rules. For why those limits matter, see human in the loop AI; for the parts inside each agent, see how AI agents work.
FAQ
What is an example of a multi-agent system?
A research assistant where a lead agent splits a question into sub-topics, several sub-agents search the web in parallel, and the lead writes up what they found. Anthropic's research feature works this way. In business, a common one is a lead that sends a finance agent to check invoices and an inbox agent to draft replies, with a skeptic reviewing both before anything goes out.
Is multi-agent AI better than a single agent?
Sometimes. It does better on jobs that split into independent parts and benefit from review, such as broad research. It does worse, and costs more, on tightly linked work where every step depends on the last. Most builders' advice is to start with one agent and split only when it struggles.
How much more does multi-agent AI cost?
It uses far more tokens. Anthropic measured multi-agent systems at about fifteen times the tokens of a chat, against about four times for a single agent. That's why it's worth reserving for valuable jobs, and why a per-job budget matters.
What does a skeptic or critic agent do?
It reviews other agents' findings before they reach you: checking the evidence, recomputing numbers another way, and looking for what was missed. Because it doesn't share the original agent's assumptions, it catches errors the original agent can't see in its own work.
Do I need to code to use multi-agent AI?
Not necessarily. Frameworks like crewAI, LangGraph and Microsoft Agent Framework are for developers. Products like crew bot give you a ready-made crew you direct in plain language, with approvals on your phone.
Sources
- Anthropic: How we built our multi-agent research system (June 2025)
- OpenAI: A practical guide to building agents
- Anthropic: Effective context engineering for AI agents (September 2025)
- Du et al.: Improving Factuality and Reasoning in Language Models through Multiagent Debate (2023)
- Cognition: Don't Build Multi-Agents (June 2025)
- Cognition: Multi-Agents, What's Actually Working (April 2026)
- Cemri et al.: Why Do Multi-Agent LLM Systems Fail? (2025)
- crewAI on GitHub
- crewAI docs: Processes (sequential and hierarchical)
- Microsoft AutoGen on GitHub
- Wu et al.: AutoGen, Enabling Next-Gen LLM Applications via Multi-Agent Conversation (2023)
- Microsoft Learn: Microsoft Agent Framework overview
- LangChain docs: LangGraph overview


