Opinion Consensus Formation Among Networked Large Language Models
This paper investigates how networked large language models reach consensus through multi-round text exchanges, finding that while their convergence dynamics align with classical DeGroot models regarding decay rates and graph topology, their final opinions are driven more by inherent biases and discussion subjects than by initial conditions or network centrality.
Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Imagine a group of 20 friends sitting in a circle, each holding a different opinion about a controversial topic like "Is Bitcoin a good investment?" or "Should we be vegan?" In the real world, if these friends talked to each other for a while, they might eventually agree on something.
This paper asks a simple question: If we replace those human friends with Artificial Intelligence (AI) chatbots, will they behave the same way? Specifically, do they follow the same mathematical rules that scientists have used for decades to predict how human groups reach agreement?
Here is the breakdown of what the researchers found, using simple analogies:
1. The Old Rulebook (The DeGroot Model)
For a long time, mathematicians have used a rulebook called the DeGroot model to predict group opinions. Think of it like a weighted average.
- The Theory: If you trust your neighbor 50% and yourself 50%, your new opinion is the average of yours and theirs. If you are a "hub" in the network (connected to many people), your opinion should carry more weight in the final group decision.
- The Prediction: The final group opinion should be a perfect mathematical blend of everyone's starting opinions, weighted by how central they are in the network.
2. The Experiment: AI Friends in a Chat Room
The researchers set up a digital playground with 20 AI agents.
- The Setup: They connected these AIs in different shapes (some in a tight circle, some in a loose web).
- The Rules: They told the AIs, "You are either 'self-confident' (trust yourself more) or 'open-minded' (trust others more)." They gave them a topic (like "Ghosting" or "Gene Editing") and let them chat back and forth for 80 rounds.
- The Measurement: After every chat, a separate AI acted as a judge, scoring the tone of the conversation from "Strongly Against" (-3) to "Strongly For" (+3).
3. The Big Surprise: The "Echo Chamber" Effect
The researchers found two main things:
A. They do agree, but not for the reasons we thought.
Just like the old rulebook predicted, the AI agents eventually stopped disagreeing. Their opinions converged, and the "noise" between them died down exponentially (like a echo fading away).
- However: The final opinion they reached did not match the mathematical prediction.
- The Analogy: Imagine a group of people trying to guess the weight of a pumpkin. The old math says the final guess should be the average of everyone's starting guesses. But in this experiment, the AIs ignored their starting guesses almost entirely. Instead, they all ended up agreeing on a specific number that seemed to come from inside the AI itself, not from the group discussion.
B. The "Inherent Bias" is the real boss.
Why did they ignore the math? Because the AIs have built-in biases from their training (the data they were fed before the experiment started).
- The Analogy: Imagine the AIs are like people who grew up in a specific culture. Even if you put them in a room with people from all over the world, they might all secretly lean toward a specific cultural viewpoint.
- The Finding: If the topic was "Bitcoin," the AIs tended to lean negative, regardless of whether they started out positive or negative. If the topic was "Veganism," they leaned positive. The topic and the AI's internal training mattered far more than who was talking to whom or who started with what opinion.
4. What Did Follow the Old Math?
While the final answer was wrong according to the old math, the speed at which they agreed was spot on.
- The Analogy: Think of a crowded room where everyone is shouting. The old math predicts exactly how long it takes for the room to go quiet.
- The Finding: The researchers found that the time it took for the AIs to stop disagreeing matched the mathematical predictions perfectly. If the network was more connected (more friends talking to more friends), they agreed faster. If the network was sparse, it took longer. The "speed limit" of the agreement was determined by the shape of the network, just as the old math said.
5. The "Self-Confidence" Factor
The researchers also tested what happens if they explicitly tell the AIs, "Trust yourself 80% and your friends 20%."
- The Result: When the AIs were given these specific "trust weights," they reached a consensus much more easily. When the researchers removed these instructions, the AIs were more chaotic and disagreed more at the end. It seems that giving AI agents clear rules on how much to trust themselves helps them settle down faster.
Summary
- Do AI agents reach a consensus? Yes, they stop arguing and agree on a point.
- Does the old math predict what they agree on? No. The final opinion is driven by the AI's hidden biases and the topic, not by the starting opinions of the group.
- Does the old math predict how fast they agree? Yes. The speed of agreement depends entirely on how the network is connected, just like the old math predicted.
The Takeaway: If you want to simulate a social network with AI, you can trust the math to tell you how fast they will agree, but you cannot trust the math to tell you what they will agree on. The AI's internal "personality" (bias) overrides the group dynamics.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.