Forwarded this email? Subscribe here for more

Agents are actors

Multi-agent is actor model

Gordon Brander

Apr 20

How should AI agents cooperate? What should a multi-agent system look like? Everyone is trying to figure this out right now. Should our agents be thought of as a team that coordinates over an issue tracker? Are they more like a swarm of bees or ants? Should they be arranged into command-and-control hierarchies of agent and sub-agent? Or should we trust the bitter lesson and bet on one big model? Here’s my take:

Agents are actors. Multi-agent is just the actor model.

An actor…

Receives messages
Updates its internal state
May spawn other actors
And generate messages in response

That sounds a lot like an agent! An agent receives a user message, it updates its context, it may spawn other agents, and generate messages in response.

It also sounds a lot like Von Foerster’s non-trivial machine, a cybernetic model of the minimal system that can generate agentic behavior: a function that accumulates state through feedback (aka, a reducer).

$\"\"$

The Non-Trivial Machine, a function with feedback. The minimal definition of agency. Source: Heinz von Foerster, “Understanding Understanding: Essays on Cybernetics and Cognition”.

I have a degree in molecular biology, and one of the things that struck me as I was studying molecular biology, was that, compared to the kinds of structures that we tend to build here on earth, the average biological structure is more than a thousand times as complex… For instance, a grand piano, a rather complex machine, has about 20,000 parts. Our bodies have approximately a trillion cells, and each cell has many millions of components in its own right…
One of the ways nature discovered to control complexity, and the kinds of interactions that are likely to happen, is to try and encapsulate them in various ways… What biological systems encapsulate is the environment in which processing takes place… If you give each cell its own captured ocean, and let it devote about 90% of its energies toward protecting itself from the outside world, then you get a situation where you can build very large structures rather safely.
(Alan Kay, OOP talk)

$\"\"$

Wassily Kandinsky, 1938, “Entassement réglé”

If each agent is a cell, how can we make the jump to multicellularity?

OOP never properly made this jump, and it never attained the sublime levels of biological complexity that Kay envisioned. This is because mainstream OOP languages had fatal design mistakes that broke compositionality. Actors fix this. There are multiple formal mathematical models that let us reason about actor composition at scale.

To scale up our multi-agent systems, we could borrow some ground rules from actors:

Strong encapsulation: Actors never share state. They are strongly-encapsulated black boxes. Information sharing happens exclusively through sending messages.
State machines: Messages that get sent to an actor’s inbox are processed one at a time, sequentially, resulting in discrete state updates.
Concurrent messages: Actors process messages sequentially, but the messages themselves are sent and received asynchronously.
Location transparency: Because messages are sent asynchronously, sending a message to another actor looks the same whether the actor is running locally, or remotely on another computer.

These qualities make it very easy to parallelize actors. You don’t have any of the problems of shared mutable state, because there is no shared mutable state. The system can scale horizontally, from one process to many, and from one computer to many.

Designing our agents as actors lets us spin up lots of parallel agents. Now what? How should these swarms of agents interact and be structured? Here too, the actor model offers useful patterns:

Supervisor trees: parent actors manage children, handling any failures by restarting them, stopping them, or escalating the failure up the tree.
Request-response: short-lived actors get spawned to perform a request. They respond with the result, then die.
Become: an actor replaces its own message-handling behavior based on reaching. a state, effectively becoming another actor.
Scatter-gather: A coordinator sends queries to N actors in parallel, collects their replies, and produces an aggregated result once all have responded or a timeout fires.
Routers and worker pools: a router actor parallelizes work by distributing incoming messages to a pool of identical worker actors using round-robin, random, smallest-mailbox, etc.
Aggregators: collect related messages over time, then emit a combined result once a condition is met.

This is just a sample of the patterns that emerge naturally from the actor model. It is pretty easy to imagine how they might be useful in a multi-agent system. Some of them are already common: scatter-gather is used for Claude Code’s Explore agents, and prompt resolvers are a riff on the become pattern.

Actor agents could allow us to run hundreds of parallel agents on a computer, or thousands across load-balanced servers, or even millions of agents across the whole internet. With location transparency, “Have your agent call my agent” and “have your factory call my factory” become essentially the same move.

Furthermore, if every agent signs its messages with a public key, we get a decentralized protocol for massively multi-agent systems.

Signed messages give us the basis for untrusted coordination between agents. Because signed messages are non-repudiable, we can begin to accrue cryptographically-verifiable reputations for specific agents, and distribute those reputations through webs of trust. Our agents can decide whether to interact with another agent based on the agent’s reputation.

It is also pretty easy to imagine how we might extend such a decentralized agent protocol to enable end-to-end encrypted communication between agents. In the actor model, actors send messages directly to other actors using an address, so just encrypt the message, and send directly to the other agent’s address.

The implementation for such a protocol could be very simple. Sign JSON with an agent-controlled key, send it over the wire. For the details, I would be inclined to borrow from Nostr for message signing, ATProto for DID-based signing and key rotation, and UCAN for delegating authority from user to agent to sub-agent. But in many ways, this protocol problem is simpler than the problem of decentralizing social media. Actor communication is point-to-point, rather than broadcast, so it’s a good fit for HTTP. In its most basic incarnation, an agent could be a URL, its address could be a POST request to that URL, and messages could be signed with a JWT.

Reflecting on this, I feel like I can begin to see the shape of a new internet, something that may supersede the web: the internet of agents.

","enableWebSigning","origin","homeMetadata",{"_579":1038,"_1039":602,"_1040":1041},"originHomeId",{"_595":568,"_37":1081,"_572":1507,"_566":-5,"_597":-5,"_598":-5,"_599":-5,"_600":-5},[],"meta",{"_1510":1511,"_1655":1656},"values",{"_1512":1513,"_1515":1516,"_1517":1518,"_1519":1520,"_1522":1523,"_1524":1525,"_1526":1527,"_1529":1530,"_1531":1532,"_1533":1534,"_1535":1536,"_1537":1538,"_1539":1540,"_1541":1542,"_1543":1544,"_1545":1546,"_1547":1548,"_1549":1550,"_1551":1552,"_1553":1554,"_1555":1556,"_1557":1558,"_1559":1560,"_1561":1562,"_1563":1564,"_1565":1566,"_1567":1568,"_1569":1570,"_1571":1572,"_1573":1574,"_1575":1576,"_1577":1578,"_1579":1580,"_1581":1582,"_1583":1584,"_1585":1586,"_1587":1588,"_1589":1590,"_1591":1592,"_1593":1594,"_1595":1596,"_1597":1598,"_1599":1600,"_1601":1602,"_1603":1604,"_1605":1606,"_1607":1608,"_1609":1610,"_1611":1612,"_1613":1614,"_1615":1616,"_1617":1618,"_1619":1620,"_1621":1622,"_1623":1624,"_1625":1626,"_1627":1628,"_1629":1630,"_1631":1632,"_1633":1634,"_1635":1636,"_1637":1638,"_1639":1640,"_1641":1642,"_1643":1644,"_1645":1646,"_1647":1648,"_1649":1650,"_1651":1652,"_1653":1654},"document.generationInfo.generation",[1514],"bigint","dehydratedState.queries.0.state.data.document.generationInfo.generation",[1514],"dehydratedState.queries.1.state.data.document.generationInfo.generation",[1514],"dehydratedState.queries.1.queryKey.2",[1521],"undefined","dehydratedState.queries.2.state.data.0.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.0.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.0.sortTime",[1528],"Date","dehydratedState.queries.2.state.data.0.activitySummary.latestCommentTime",[1521],"dehydratedState.queries.2.state.data.0.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.0.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.0.redirectInfo",[1521],"dehydratedState.queries.2.state.data.1.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.1.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.1.sortTime",[1528],"dehydratedState.queries.2.state.data.1.activitySummary.latestCommentTime",[1521],"dehydratedState.queries.2.state.data.1.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.1.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.1.redirectInfo",[1521],"dehydratedState.queries.2.state.data.2.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.2.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.2.sortTime",[1528],"dehydratedState.queries.2.state.data.2.activitySummary.latestCommentTime",[1521],"dehydratedState.queries.2.state.data.2.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.2.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.2.redirectInfo",[1521],"dehydratedState.queries.2.state.data.3.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.3.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.3.sortTime",[1528],"dehydratedState.queries.2.state.data.3.activitySummary.latestCommentTime.seconds",[1514],"dehydratedState.queries.2.state.data.3.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.3.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.3.redirectInfo",[1521],"dehydratedState.queries.2.state.data.4.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.4.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.4.sortTime",[1528],"dehydratedState.queries.2.state.data.4.activitySummary.latestCommentTime",[1521],"dehydratedState.queries.2.state.data.4.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.4.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.4.redirectInfo",[1521],"dehydratedState.queries.2.state.data.5.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.5.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.5.sortTime",[1528],"dehydratedState.queries.2.state.data.5.activitySummary.latestCommentTime.seconds",[1514],"dehydratedState.queries.2.state.data.5.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.5.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.5.redirectInfo",[1521],"dehydratedState.queries.2.state.data.6.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.6.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.6.sortTime",[1528],"dehydratedState.queries.2.state.data.6.activitySummary.latestCommentTime",[1521],"dehydratedState.queries.2.state.data.6.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.6.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.6.redirectInfo",[1521],"dehydratedState.queries.2.state.data.7.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.7.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.7.sortTime",[1528],"dehydratedState.queries.2.state.data.7.activitySummary.latestCommentTime.seconds",[1514],"dehydratedState.queries.2.state.data.7.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.7.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.7.redirectInfo",[1521],"dehydratedState.queries.2.state.data.8.createTime.seconds",[1514],"dehydratedState.queries.2.state.data.8.updateTime.seconds",[1514],"dehydratedState.queries.2.state.data.8.sortTime",[1528],"dehydratedState.queries.2.state.data.8.activitySummary.latestCommentTime",[1521],"dehydratedState.queries.2.state.data.8.activitySummary.latestChangeTime.seconds",[1514],"dehydratedState.queries.2.state.data.8.generationInfo.generation",[1514],"dehydratedState.queries.2.state.data.8.redirectInfo",[1521],"dehydratedState.queries.5.state.data.document.generationInfo.generation",[1514],"dehydratedState.queries.5.queryKey.2",[1521],"dehydratedState.queries.6.state.data.metadata.summary",[1521],"referentialEqualities",{"_1512":1657,"_1524":1658,"_1539":1659,"_1551":1660,"_1567":1661,"_1579":1662,"_1595":1663,"_1603":1664,"_1609":1665,"_1623":1666,"_1637":1667},[1515],[1531],[1545],[1553,1559],[1573],[1581,1587],[1601],[1649],[1615],[1629],[1643],"actionData","errors"]