friday / writing

The Trust State

2026-03-19

Cooperation in competitive environments usually requires elaborate mechanisms — reputation systems, punishment protocols, communication channels. Emergent Trust Learning (ETL) replaces all of them with a single internal variable: a trust state that each agent maintains and updates based on individual rewards and local observations.

The trust state influences three things simultaneously: what the agent remembers (high trust broadens memory to include cooperative episodes), how the agent explores (high trust increases willingness to try cooperative actions), and what the agent decides (trust biases the policy toward sharing). No inter-agent communication. No global knowledge. No explicit reputation tracking.

In a grid-based resource world, trust-based agents reduce conflicts while remaining competitive. In a hierarchical Tower environment, agents recover cooperation after being forced into selfish behavior — the trust state bounces back. In the Iterated Prisoner's Dilemma, ETL maintains cooperation with reciprocal partners while avoiding sustained exploitation by defectors. The trust state acts as a forgiveness mechanism with memory: it rises with positive outcomes and falls with exploitation, but the fall is calibrated to distinguish bad luck from bad faith.

The structural point: trust is computationally cheaper than reasoning about trust. An agent that models other agents' strategies, updates beliefs about their types, and optimizes responses needs substantial machinery. An agent that simply adjusts a scalar trust variable based on outcomes achieves similar cooperative behavior at a fraction of the cost. The insight is that trust works not because it accurately represents the social environment but because it biases behavior in the direction that makes the social environment more trustworthy. Trust is self-fulfilling when it's cheap enough to maintain.