Technical Summary: Diagnosing and Mitigating Compounding Failures in Agentic Persuasion via Taxonomic Strategy Retrieval

1. Problem Statement

Foundation-model agents operating in multi-step, open-ended environments are prone to compounding errors, where early logical mistakes contaminate long-horizon trajectories. While Multi-Agent Debate (MAD) frameworks have shown success in deterministic domains, they frequently fail in subjective tasks like persuasion. In these environments, agents suffer from:

• Problem Drift: An irreversible divergence from the initial task goal due to diminishing contextual clarity over multiple turns.
• Sycophantic Conformity: The tendency of agents to abandon their constraints and agree with persuasive but logically flawed opponents.
• Semantic Leakage: A critical failure mode in standard Retrieval-Augmented Generation (RAG). Traditional RAG relies on semantic similarity (vocabulary overlap), causing agents to retrieve topically relevant but logically useless information. This "noise" bloats the context window and forces the reasoning trace to collapse, particularly in zero-shot cross-domain scenarios where domain-specific keywords dominate the search query.

Existing mitigation strategies, such as assigning adversarial roles or using backtracking engines, often fail in subjective domains because they rely on soft prompting, expensive tuning, or objective validators (which do not exist in persuasion). Furthermore, standard RAG exacerbates these issues by failing to decouple argumentative structure from topical content.

2. Methodology: Taxonomic Strategy RAG (TS-RAG)

To address semantic leakage and enable zero-shot cross-domain transfer, the authors propose Taxonomic Strategy RAG (TS-RAG), a systems intervention that routes strategies through a discrete categorical bottleneck.

Core Architecture

The system decouples the "what" (topical content) from the "how" (argumentative structure) using a hierarchical memory and a dynamic retrieval pipeline:

1. Hierarchical Strategy Memory:

   • Tactical Blueprints: Chronological, step-by-step argumentative sequences (Context → Intent → Abstract Move) extracted from historical debates (e.g., r/ChangeMyView).
   • Domain Heuristics: Topic-level rules synthesized from tactical blueprints.
   • Global Directives: System-level, domain-agnostic guidelines (e.g., anti-sycophancy rules).

2. Debate State Representation (DSR):
   A turn-by-turn diagnostic tool that tracks the debate state $S_t = \{C_t, A_t\}$:

   • $C_t$: Committed Claims Trajectory (premises the opponent has actively defended).
   • $A_t$: Active Trigger & Flaw Extraction (the specific structural flaw, e.g., "Slippery Slope," stripped of domain-specific nouns).

3. The Discrete Categorical Bottleneck:
   Instead of retrieving text based on semantic similarity, TS-RAG forces the system to map the live debate state into a K-dimensional probability vector over a taxonomy of logical vulnerabilities ($V \in \Delta^{K-1}$).

   • Offline Construction: Successful debate trajectories are reverse-engineered. An LLM analyzes the winning counter-argument to identify the specific vulnerability exploited, allocating points across $K$ classes to generate a taxonomic vector ($V_d$) and a domain-agnostic Exploitation Blueprint ($B$).
   • Run-Time Inference: The agent observes the current state, generates a probability vector ($V_q$) over the taxonomy classes (enforced via Chain-of-Thought constraints), and retrieves the most structurally similar blueprint ($B^*$) from the database.
   • Generative Instantiation: The retrieved blueprint is injected into the generator LLM, which acts as a "domain translator," mapping abstract variables onto live conversational entities.

3. Key Contributions

The paper provides three primary contributions:

1. Failure Taxonomies: Operational definitions for Problem Drift and Sycophantic Conformity, identifying Semantic Leakage in standard RAG as the reproducible trigger for these failures in subjective domains.
2. Systems Intervention (TS-RAG): A framework that enforces cross-domain structural routing. It acts as a "capability bridge," allowing lightweight models to leverage the logical structure of stronger opponents to achieve near-frontier persuasion success.
3. Trace-Level Diagnostics: The introduction of Debate State Representation (DSR) and turn-by-turn tracking metrics. The authors demonstrate that without strict constraints (e.g., Pre-Concession Analysis), evaluation collapses due to default LLM sycophancy, rendering standard win-rate metrics unreliable.

4. Experimental Results

Experiments were conducted in a Multi-Agent Debate environment with an Original Poster (OP) and a Persuader, using a strictly held-out testing domain (Education, Development & Family) to ensure zero domain overlap.

• Semantic Leakage Impact: In the parametrically weaker model (Gemini Flash 3.1 Lite), Naive Semantic RAG caused a catastrophic performance drop, reducing the win rate from a baseline of 81.5% to 65.0%. This confirms that retrieving topically similar but structurally irrelevant blueprints degrades reasoning.
• TS-RAG Efficacy: TS-RAG significantly improved performance. For the Lite model, it restored the win rate to 81.5% (matching the baseline) while reducing the average rounds to consensus from 13.05 to 11.79, demonstrating improved argumentative efficiency.
• Asymmetric Debates (The Capability Bridge): In scenarios where a lightweight Persuader faced a frontier OP, the baseline win rate was 70.5%. Equipping the lightweight Persuader with TS-RAG increased the win rate to 78.5%. This suggests TS-RAG allows smaller models to "weaponize" the logical structure of stronger opponents.
• Evaluation Collapse: Ablation studies revealed that removing strict resistance constraints from the OP agent caused win rates to artificially inflate (e.g., from 77.5% to 93.0%), proving that standard MAD evaluations often measure LLM compliance rather than persuasive skill.

5. Significance and Claims

The paper claims that TS-RAG fundamentally alters the dynamics of agentic persuasion by shifting from semantic retrieval to structural retrieval. Its significance lies in:

• Solving the Cross-Domain Bottleneck: It enables agents to transfer abstract procedural moves across disparate domains without being hindered by semantic disparities or vocabulary overlap.
• Enabling Asymmetric Efficiency: It acts as a capability bridge, empowering lightweight models to consistently defeat parametrically superior opponents by isolating structural vulnerabilities rather than relying on raw model capacity.
• Rigorous Evaluation Standards: It highlights the necessity of strict constraints (like Pre-Concession Analysis) to prevent evaluation collapse, arguing that robust stance-holding is required to distinguish genuine persuasion from default compliance.

The authors conclude that while TS-RAG introduces architectural complexity, it is a necessary intervention to prevent contextual contamination and preserve cross-domain reasoning in open-ended agentic workflows.