Do LLM Embedding Spaces Recover Expert Structure?

Technical Summary: Do LLM Embedding Spaces Recover Expert Structure?

Problem Statement
Pretrained text embeddings are increasingly utilized as representational maps where geometric distances between texts are compared against independently specified conceptual structures. However, high category separability (e.g., the ability to classify communities) does not necessarily imply that the embedding geometry recovers fine-grained, expert-defined semantic relations. This problem is acute in mental-health language, where categories exhibit symptom overlap and graded boundaries, providing an external expert reference. Yet, online communities introduce strong non-clinical confounds, including subreddit-specific jargon, stylistic norms, and broad domain splits (mental-health vs. control). A model may successfully cluster communities based on these coarse distributional cues without encoding the underlying symptom-level relations that define the expert structure. The paper investigates whether LLM embedding spaces recover expert-defined symptom structure beyond coarse domain separation and how task-specific supervision and model scale influence this geometry.

Methodology
The study utilizes a dataset of 28 Reddit communities (17 mental-health specific, 11 control) spanning 2018–2020. The authors compare pretrained and supervised fine-tuned embedding spaces using two model scales: Qwen3-Embedding-0.6B and Qwen3-Embedding-4B.

The evaluation framework employs three complementary analyses:

1. Representational Similarity Analysis (RSA): The authors construct category prototypes by averaging document embeddings. They generate a Representational Dissimilarity Matrix (RDM) based on cosine distances between these prototypes. This model-derived RDM is compared against two reference matrices: an expert-derived symptom matrix (based on Jaccard distances of binary symptom profiles) and a domain-control matrix. RSA is computed as the Spearman rank correlation between the upper-triangular entries of these matrices.
2. Prototype-Based Typicality and Boundary Analysis: To examine local structure, the authors calculate document typicality (distance to the category prototype) and prototype margins. They define a "boundary alignment score" ($\Delta_{align}$) to measure whether residual boundary ambiguity is concentrated among expert-neighbor category pairs (those with high symptom overlap) versus non-neighbor pairs.
3. Multi-Baseline Confound Controls: To ensure alignment is not driven by non-clinical signals, the authors control for four baselines: Valence-Arousal-Dominance (VAD) affective scores, LIWC linguistic categories, lexical style features, and topic-distribution structures (via Embedded Topic Models).

Key Results

• Expert Structure Recovery: Pretrained embeddings show measurable alignment with expert-defined symptom structure within the mental-health subset, even without supervision. This alignment is significantly stronger than what would be expected from coarse domain separation alone.
• Impact of Supervision: Supervised fine-tuning strengthens the alignment with expert structure, with the most significant gains observed at the finest category level (within the mental-health subset). Fine-tuning does not merely increase global separability; it reshapes the geometry to reduce "off-structure" ambiguity while concentrating residual uncertainty among expert-neighbor pairs.
• Model Scale Effects: Larger model scales (4B vs. 0.6B) improve both zero-shot alignment and the gains induced by supervision. The 4B model achieves higher RSA scores and shows a more pronounced reduction in associations with non-clinical baselines.
• Confound Robustness: The observed alignment persists even after controlling for VAD, LIWC, lexical style, and topic distributions. While content-rich baselines (like topic distributions) explain a portion of the alignment, a substantial residual alignment with the expert structure remains, suggesting the geometry captures more than just discourse or affective regularities.
• Local Organization: Fine-tuning reduces diffuse boundary ambiguity. Topics associated with boundary-blurring in zero-shot models (shared affective narratives) are sharpened in fine-tuned models, which exhibit more concentrated, category-specific lexical fields.

Significance and Claims
The paper argues that LLM embeddings can recover expert-relevant category geometry, but this recovery is partial, level-dependent, and shaped by supervision and scale. The authors caution that classification performance alone is insufficient to infer semantic structure; explicit controls for confounds and level-stratified analyses are necessary.

Key contributions include:

• A representation-level framework combining RSA, prototype-based typicality, and multi-baseline confound controls to test for expert-structure recovery beyond domain separation.
• Empirical evidence of a level-dependent pattern where pretrained models encode symptom-level organization, and supervision amplifies this alignment most effectively at the finest granularity.
• Demonstration that larger scales and supervision jointly reduce associations with non-clinical baselines, yielding more category-specific geometry.

Limitations
The authors explicitly note that their expert reference is a structured benchmark for category-level comparison, not a clinical diagnostic ontology capable of capturing individual-level severity or comorbidity. The findings support a limited claim: pretrained embeddings contain meaningful but incomplete organizational signals, which supervision strengthens. The study is limited to a specific model family and dataset; generalizability across architectures and less community-specific language sources remains an open question. Furthermore, topic-based analyses are interpretive rather than causal.