Epistemic Trust as a Mechanism for Ethics Integration: Failure Modes and Design Principles from 70 Moral Imagination Workshops

1. Problem Statement

The paper addresses a critical bottleneck in Responsible Innovation (RI) and Ethics Integration: the frequent failure of bottom-up ethical interventions to achieve genuine practitioner engagement.

• The Context: Technology development often outpaces regulation, leaving companies to self-regulate. While top-down compliance exists, there is a push for bottom-up initiatives where engineering teams proactively engage in ethical reflection.
• The Challenge: These interventions often fail because practitioners (engineers) perceive them as irrelevant, adversarial, disconnected from technical work, or as "check-box" compliance rituals.
• The Gap: Existing literature (e.g., Socio-Technical Integration Research, Value Sensitive Design) describes how to integrate ethics but lacks a systematic analysis of why some interventions succeed in engaging practitioners while others are dismissed. There is a need to understand the conditions under which practitioners regard ethical content as credible and actionable.

2. Methodology

The authors employ a practice-based qualitative inquiry grounded in the analysis of a specific intervention methodology called Moral Imagination.

• Data Source: Systematic analysis of 70+ workshops conducted with engineering teams at Google between 2019 and 2025, involving approximately 1,000 participants.
• Intervention Design: The "Moral Imagination" workshop is a 1–2 day structured intervention based on pragmatist philosophy (Dewey, Werhane). It uses Technomoral Scenarios (TMS)—narratives projecting technology into future contexts—to trigger "dramatic rehearsal" (imagining consequences) and perspective-taking.
• Data Collection:
  • Intervention artifacts (agendas, scenario drafts, responsibility objectives).
  • Contemporaneous records (facilitator notes, debrief memos, field notes from non-participant observation).
  • Retrospective elicitation (semi-structured interviews with facilitators and a subset of participants).
• Analytical Approach: An abductive, two-stage process:
  1. Incident Extraction: Identifying "critical incidents" where engagement succeeded, stalled, or was resisted.
  2. Coding & Synthesis: Coding incidents against five pre-defined dimensions of Epistemic Trust to identify recurring patterns of failure and success.
• Limitations Acknowledged: The study relies on voluntary participation (selection bias), lacks formal outcome metrics, and is context-specific to a large tech company. The findings are presented as "practitioner hypotheses" rather than causal proofs.

3. Key Contributions

The paper makes three primary contributions to the literature on socio-technical integration:

1. Conceptual Framework: It introduces Epistemic Trust as the central mechanism linking intervention design to engagement outcomes. It defines this as the degree to which practitioners view an intervention, its facilitators, and its content as credible, relevant, and actionable.
2. Failure Mode Typology: It identifies 23 distinct failure modes organized across five dimensions of epistemic trust, plus four cross-cutting failure modes.
3. Design Principles: It derives 9 actionable design principles to mitigate these failure modes, providing a bridge from theory to workshop practice.

4. Results: The Epistemic Trust Model

The core finding is that successful ethics integration depends on cultivating epistemic trust across five specific dimensions. When these are inadequately addressed, specific failure modes emerge.

The Five Dimensions & Associated Failure Modes

1. Relevance: The perception that ethical content connects to actual technical work.
   • Failures: External imposition (feeling judged), abstraction without connection (principles not linked to code/design), scenario irrelevance (scenarios too generic or distant), conversational drift (shifting to personal values rather than technical implications).
2. Inclusivity: The ability of diverse voices (especially junior/non-technical) to participate without fear.
   • Failures: Hierarchy reproduction (seniors dominate), premature consensus (avoiding conflict), role-play resistance (viewing exercises as childish).
3. Agency: The feeling that participants are active deliberators, not passive recipients.
   • Failures: Passive reception (waiting for answers), responsibility deflection (blaming legal/policy), calibration failures (scenarios too simple or too complex), facilitation rigidity or drift.
4. Authority: The credibility of facilitators and the accessibility of content.
   • Failures: Technical incredibility (facilitator lacks technical fluency), register dominance (jargon alienates either side), perceived naïveté (ignoring business constraints), challenge perceived as attack.
5. Alignment: The perception that ethics supports, rather than hinders, project goals.
   • Failures: Adversarial framing (ethics as a blocker), temporal discounting (prioritizing immediate deadlines over long-term risks), goal divergence (misaligned expectations), isolation from practice (insights not integrated into project artifacts).

Cross-Cutting Failure Modes

These involve trade-offs between dimensions:

• Credibility-Connection Trap: Gaining technical authority may lead to uncritical acceptance of engineering frames; challenging frames may undermine authority.
• Participation Paradox: Structured exercises to ensure inclusivity can feel forced, undermining agency.
• Co-optation Risk: Aligning ethics with team goals can turn ethics into a tool for optimization rather than critical reflection.
• Expertise Hierarchy: Highly expert facilitators may inadvertently silence participants.

5. Design Principles (Mitigation Strategies)

To address the failure modes, the authors propose nine design principles:

1. Contextual Tailoring: Scenarios and content must be bespoke to the specific project, use cases, and technical constraints.
2. Non-Adversarial Framing: Position ethics as a resource for achieving objectives, not an external constraint or judgment.
3. Dual-Expertise Facilitation: Facilitators must be fluent in both technical and ethical domains (or use co-facilitation) to maintain credibility and accessibility.
4. Structured Voice Distribution: Actively manage speaking time to prevent hierarchy dominance and ensure dissent is voiced (e.g., written before verbal).
5. Deliberative Ownership: Position participants as the primary source of ethical reasoning; facilitators scaffold rather than dictate.
6. Benevolent Challenge: Challenge assumptions collaboratively, modeling intellectual humility and acknowledging constraints.
7. Goal Transparency: Explicitly negotiate and surface divergent goals between facilitators and teams during intake.
8. Artefact Integration: Translate ethical insights into native project artifacts (OKRs, PRDs) to ensure follow-through.
9. Scenario Method Framing: Explicitly explain the rationale for role-play and perspective-taking to reduce resistance.

6. Significance

• Theoretical: The paper moves beyond describing methods of ethics integration to explaining the mechanism of uptake. It posits that without epistemic trust, even well-designed frameworks will fail. It synthesizes philosophical work on testimony with organizational psychology.
• Practical: The Epistemic Trust Failure Mode Atlas (Appendix) serves as a diagnostic tool for practitioners. It allows facilitators to identify "warning signs" in real-time (e.g., "blank stares" indicating abstraction failure) and apply specific mitigation strategies.
• Strategic: It highlights the tension between Alignment and Criticality. The authors argue that while alignment is necessary for trust, it risks co-opting ethics into compliance. The proposed methodology attempts to navigate this by fostering "deliberative ownership" where teams challenge their own directions, rather than having ethics imposed on them.

In conclusion, the paper argues that the success of responsible innovation depends less on the content of ethical frameworks and more on the conditions of delivery that cultivate epistemic trust. By systematically addressing the 23 identified failure modes through the 9 design principles, organizations can transform ethics from a perceived barrier into an integrated, actionable part of the engineering process.