💬 NLP

Are You the A-hole? A Fair, Multi-Perspective Ethical Reasoning Framework

This paper proposes a neuro-symbolic framework that combines language models with Weighted Maximum Satisfiability (MaxSAT) solvers to aggregate conflicting natural language judgments into logically consistent ethical verdicts, demonstrating superior performance over majority voting on the r/AmItheAsshole dataset.

Original authors: Sheza Munir, Ahanaf Rodoshi, Sumin Lee, Feiran Chang, Xujie Si, Syed Ishtiaque Ahmed

Published 2026-05-04

📖 5 min read🧠 Deep dive

CC BY 4.0

Original authors: Sheza Munir, Ahanaf Rodoshi, Sumin Lee, Feiran Chang, Xujie Si, Syed Ishtiaque Ahmed

Original paper licensed under CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

Imagine you are trying to solve a messy family argument. Usually, the way we decide who is "right" is by taking a vote: whoever has the most people shouting their side wins. But what if the loudest voices are just the most emotional, or the most popular, rather than the most logical? What if the quiet person with the best evidence gets drowned out?

This paper, titled "Are You the A-hole? A Fair, Multi-Perspective Ethical Reasoning Framework," proposes a new way to settle these arguments. Instead of a simple popularity contest, the authors built a "moral referee" that listens to why people think something is wrong, not just how many people think it.

Here is how their system works, broken down into simple concepts:

1. The Problem: The "Hivemind" vs. The Truth

The researchers looked at a popular internet forum called r/AmItheAsshole (AITA). On this site, people post stories about their personal conflicts, and strangers vote on whether the poster is the "Asshole" (YTA), "Not the Asshole" (NTA), or if everyone is at fault.

The Old Way: The site uses a "Judgement Bot" that looks at the top-voted comment after 18 hours and declares that the winner.
The Flaw: This is like deciding a court case based on who has the biggest megaphone. It ignores good arguments made later, it gets confused by cultural differences, and it often rewards emotional outbursts over logical reasoning.

2. The Solution: The "Neuro-Symbolic" Referee

The authors created a two-step system that acts like a super-smart judge who can read thousands of comments at once and find the most logical conclusion.

Step A: The Translator (The "Neural" Part)

First, they use a powerful AI (a Large Language Model) to read every single comment. Instead of just counting votes, the AI acts like a translator. It takes messy, emotional human language and turns it into a clean, structured checklist.

It asks: "Did the person cause harm?" "Did they intend to do it?" "Did they show empathy?" "Did they apologize?"
It also grades the quality of the argument: "Is this person being fair?" "Are they biased?" "Is their reasoning strong?"

Think of this as converting a chaotic courtroom shouting match into a neat spreadsheet of facts and evidence.

Step B: The Logic Engine (The "Symbolic" Part)

Once the AI has the checklist, the system passes it to a mathematical solver (called Z3). This is the "brain" that does the heavy lifting.

The "Split-Stream" Trick: The system separates facts from feelings.
- Stream 1 (Facts): If someone is a brilliant logician but emotionally tone-deaf, their facts get a high score, but their feelings get a low score.
- Stream 2 (Feelings): If someone is very empathetic but bad at logic, their feelings get a high score, but their facts get a low score.
The Weighted Vote: Instead of every comment counting as "one vote," the system treats comments like witness testimony. A well-reasoned, fair comment gets a heavy weight (like a judge's gavel). A biased, emotional rant gets a light weight (like a whisper).
The Goal: The solver tries to find the single version of the story that causes the least amount of logical conflict while respecting the heavy-weighted testimony. It's like solving a puzzle where you have to fit all the pieces together without forcing them.

3. The Verdict: Logic Over Popularity

Once the math is done, the system applies a set of logical rules (based on legal principles like "guilty mind") to decide the final label:

No Harm? You are innocent (NTA).
Intentional Harm? You are the Asshole (YTA).
Accident + Apology? It's a tragedy, but forgivable (NAH).
Accident + No Apology? You are the Asshole for not fixing it (ESH).

4. The Results: Did It Work?

The researchers tested this on 600 high-conflict stories.

The Shift: In 62% of the cases, their system gave a different verdict than the popular internet vote.
The Trend: The system was often stricter. It frequently flipped "Not the Asshole" (NTA) to "You're the Asshole" (YTA). Why? Because the popular vote often ignored hidden details or missed the fact that someone was being unkind, while the logic engine caught the inconsistencies.
Human Agreement: When independent human experts looked at the system's new verdicts, they agreed with the machine 86% of the time. This proves the system isn't just making random math errors; it's finding a "truth" that humans also recognize.

The Big Takeaway

This paper argues that we shouldn't just count votes to decide what is right or wrong. Instead, we should count the quality of the reasoning.

By combining a smart AI that understands language with a math engine that understands logic, the authors built a system that filters out the "noise" of mob mentality and highlights the "signal" of fair, logical thinking. It's a way to ensure that in a world of shouting, the best arguments actually win.

1. Problem Statement

Current methods for aggregating human judgments in AI, particularly in high-conflict domains like ethical reasoning, rely heavily on majority voting. This approach treats differing opinions as statistical noise rather than valuable signals, leading to epistemic injustice.

Limitations of Consensus: Simple vote-counting drowns out minority perspectives, amplifies "hivemind" biases, and ignores the reasoning behind a label in favor of the volume of votes.
Case Study Context: The Reddit r/AmItheAsshole (AITA) forum exemplifies this failure. Its current "Judgement Bot" locks decisions after 18 hours based solely on the most upvoted comment. This mechanism is structurally unfair, ignoring counter-arguments, suffering from geographical/time-zone biases, and reducing complex moral dilemmas to popularity contests.
Core Challenge: How to aggregate diverse, noisy, and conflicting human moral reasoning into a logically consistent, fair, and explainable verdict without suppressing valid minority perspectives.

2. Methodology

The authors propose a neuro-symbolic aggregation framework that replaces vote-counting with Weighted Maximum Satisfiability (MaxSAT). The pipeline consists of four main stages:

A. Data Collection & Preprocessing

Dataset: 600 highly controversial posts from the r/AmItheAsshole subreddit (selected from a 30k+ archive using an entropy-based metric to ensure high disagreement).
Input: Top-level comments are extracted to capture independent moral judgments, ignoring nested replies to focus on distinct arguments.

B. LLM-Based Semantic Extraction (Neural Component)

A constrained prompting strategy using GPT-5.1 parses each comment into two structured vectors:

Content Vector (Moral Claims): Encodes four binary predicates based on established moral theories (Dyadic Morality, Moral Foundations Theory, Image Repair Theory):
- Harm, Intent, Empathy, Apology.
Quality Vector (Epistemic Reliability): Scores the argument's quality on a 1–5 Likert scale across five dimensions (Justification, Ethical Grounding, Deliberation, Fairness, Unbiased Language).

C. "Split-Stream" Confidence Logic (Innovation)

To prevent logical errors where a user's competence in one area inflates their authority in another, the system decouples reasoning into two independent weighting streams based on Greene's Dual Process Theory:

Stream 1: Logical Authority ( $W_{Logic}$ ): Weights factual predicates (Harm, Intent).
- Formula: $(Justification + Deliberation) \times Non\text{-}Bias$ .
- Rationale: System 2 (cognitive/deliberative) processing is required for establishing facts.
Stream 2: Ethical Authority ( $W_{Ethic}$ ): Weights character predicates (Empathy, Apology).
- Formula: $(Ethical Principle + Fairness) \times Non\text{-}Bias$ .
- Rationale: System 1 (normative/emotional) processing is required for character judgments.
Bias Handling: Bias acts as a multiplicative scalar gate. If a comment is biased, its weight is proportionally suppressed across all predicates, rather than just adding a penalty.

D. Z3 Solver-Based Reasoning (Symbolic Component)

The extracted vectors are encoded as soft constraints into the Microsoft Z3 Theorem Prover:

Optimization: The solver seeks a single truth assignment (True/False for Harm, Intent, Empathy, Apology) that minimizes the total penalty cost of violating constraints.
Mechanism: High-quality arguments (high weights) act as strong constraints. If a high-quality expert disagrees with ten low-quality trolls, the solver aligns with the expert because satisfying the high-weight constraint minimizes the global cost.
Verdict Assignment: The resulting consensus state of the four predicates is mapped to a final label (NTA, YTA, NAH, ESH) via a hierarchical decision tree grounded in legal principles (Mens Rea) and Restorative Justice.

3. Key Contributions

Split-Stream Architecture: A novel pipeline that computationally enforces the separation of factual validity from normative character judgments, ensuring that logical deduction does not artificially inflate authority on emotional matters.
Formalization of Jurisprudence: Translates abstract moral philosophy into quantifiable soft constraints, allowing a formal solver to derive ethically coherent and logically sound verdicts rather than statistically probable ones.
Strictness Shift: Demonstrates that prioritizing reasoning quality over popularity leads to a measurable increase in accountability, overturning majority-vote verdicts in favor of more principled outcomes.

4. Results

The framework was evaluated on 600 high-conflict posts with three stages of validation:

LLM Vector Accuracy: Human reviewers validated the LLM-generated vectors, finding 81% alignment with human interpretation. Failure modes were predictable (e.g., insufficient justification).
Divergence from Majority: The solver changed the Reddit majority verdict in 62% of cases (372/600).
- The most common shift was from NTA (Not the Asshole) to YTA (You're the Asshole), indicating the system identified hidden malice or negligence missed by the crowd.
Human Agreement: Independent human evaluators (blind to the original Reddit verdict) agreed with the solver's decisions 86% of the time. This confirms the system produces outcomes consistent with human reasoning, not just formal artifacts.
Robustness: The system successfully filtered out "review bombing" and mob harassment, aligning with high-quality expert testimony rather than volume.

5. Significance and Implications

Paradigm Shift: Moves the goalpost of AI aggregation from "collecting votes" to "aggregating reasoning." It treats disagreement as a signal to be analyzed rather than noise to be eliminated.
Fairness & Accountability: By weighting arguments based on epistemic quality rather than popularity, the framework mitigates the "echo chamber" effect and protects minority perspectives that are logically sound but numerically outnumbered.
Explainability: Unlike black-box neural networks, the Z3 solver provides a transparent chain of logic (which predicates were violated and why), making the decision process auditable.
Generalizability: While tested on AITA, this neuro-symbolic approach is applicable to other high-conflict domains such as political deliberation, legal sentencing aids, hate speech detection, and medical ethics, provided the predicate ontology is adapted to the domain.

Conclusion: The study proves that coupling neural semantic extraction with formal constraint solving creates a scalable, interpretable framework for ethical decision-making that enforces logical soundness and fairness, effectively overcoming the limitations of democratic consensus in complex moral landscapes.