Development and psychometric evaluation of The Index of Myalgic Encephalomyelitis Symptoms (TIMES) Part I: Rasch Analysis and Content Validity

This study describes the development and psychometric validation of the Index of Myalgic Encephalomyelitis Symptoms (TIMES), demonstrating through Rasch analysis that the revised tool provides a stable and valid assessment of symptom frequency and severity across neurological and autonomic domains in patients with ME/CFS.

The Gist

Imagine you are trying to describe a very complex, invisible storm happening inside a person's body. This storm is Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS). For a long time, doctors and researchers have struggled to measure this storm accurately because the symptoms are so varied and hard to pin down.

This paper is about building a new, high-tech "Storm Gauge" called TIMES (The Index of Myalgic Encephalomyelitis Symptoms) to measure exactly how bad that storm is.

Here is how they built it, using simple analogies:

1. The Blueprint (Creating the List)

First, the researchers didn't just guess what to ask. They gathered a team of architects (doctors) and residents (people living with ME/CFS) to draw up a blueprint. They started with a massive list of 85 different "weather reports" (symptoms) covering eight different areas of the body, like the brain, nerves, and heart.

2. The First Test Drive (The Initial Survey)

They handed this blueprint to 721 people living with ME/CFS and asked them to fill it out. They asked two questions for every symptom:

• "How often does this happen?" (Frequency)
• "How bad does it hurt or bother you?" (Severity)

They used a 5-point scale (like a thermometer going from 1 to 5) for the answers.

3. The "Tuning" Process (Rasch Analysis)

This is the most important part. The researchers used a special mathematical tool called Rasch Analysis. Think of this like a tuner for a piano.

• When they played the first draft of the questionnaire, the piano sounded "out of tune."
• Some questions were too easy or too hard (bad targeting).
• Some questions were asking the same thing twice (local dependency).
• The 5-point scale was too confusing; people were getting stuck between the numbers.

The "tuner" told them: "Cut these broken strings, fix those loose ones, and change the scale from 5 points to 4 points to make it smoother."

4. The Second Test Drive (Validation)

After fixing the piano, they played it again with a new group of 354 people.

• The Result: The music was perfect. The questions now lined up perfectly to measure the "storm."
• The Upgrade: They realized that instead of asking "How often?" and "How bad?" separately, they could combine them into one smooth question.
• The Big Picture: They found that they could group the symptoms into smaller teams (like "Neurological Team" and "Autonomic Team") and also add up all the scores to get one big "Total Storm Score."

The Bottom Line

The paper concludes that TIMES is now a reliable, accurate ruler for measuring ME/CFS symptoms.

Why does this matter?
Before this, measuring ME/CFS was like trying to weigh a cloud with a bathroom scale—it didn't work well. Now, doctors have a precise digital scale. This means:

• Doctors can track if a treatment is actually working.
• Researchers can compare different patients fairly.
• Patients can finally say, "My storm is a 7 out of 10 today," and have that number mean something real to the medical world.

Technical Summary

Technical Summary: Development and Psychometric Evaluation of the Index of Myalgic Encephalomyelitis Symptoms (TIMES)

1. Problem Statement

Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS) is a complex, multi-system condition characterized by a wide array of debilitating symptoms. A significant challenge in clinical research and practice has been the lack of a robust, psychometrically validated instrument specifically designed to comprehensively assess the symptom burden of ME/CFS. Existing tools often lack the rigor required to distinguish between symptom frequency and severity or fail to meet modern psychometric standards (such as the Rasch model) necessary for creating reliable, interval-level measurements. This study addresses the need to develop and validate a new, scientifically sound assessment tool: The Index of Myalgic Encephalomyelitis Symptoms (TIMES).

2. Methodology

The study employed a mixed-methods approach combining qualitative input with quantitative psychometric analysis:

• Item Generation: An initial pool of 85 symptom items was developed across eight distinct domains. This process was grounded in a review of relevant literature and refined through consultation with both patient and clinician advisory groups to ensure content validity.
• Data Collection (Phase 1): An online survey was administered to a large cohort of individuals with ME/CFS ($n=721$).
  • Response Structure: Each item utilized two parallel response formats: one assessing symptom frequency and the other assessing symptom severity, both originally using five-point scales.
• Psychometric Analysis: The primary analytical framework was Rasch analysis, a probabilistic model used to evaluate:
  • Unidimensionality: Whether items within a domain measure a single underlying construct.
  • Targeting: The alignment between item difficulty and person ability (symptom severity).
  • Internal Reliability: Consistency of the measure.
  • Item Fit: How well individual items conform to the model expectations.
  • Local Dependency: Checking for items that are statistically dependent on one another beyond the latent trait.
• Refinement and Validation (Phase 2): Based on Phase 1 anomalies, items were re-formatted or removed. A revised scale featuring a single four-point response format was re-administered to a validation cohort ($n=354$) to confirm the improvements.

3. Key Contributions

• Development of TIMES: The creation of a comprehensive, domain-specific symptom index tailored explicitly for ME/CFS, co-developed with patient and clinician stakeholders.
• Rasch-Based Optimization: The study demonstrates the application of Rasch modeling to refine symptom scales, moving beyond classical test theory to ensure interval-level measurement properties.
• Structural Simplification: The research identified that a four-point response format is superior to the traditional five-point format for this population, reducing respondent burden and improving data quality.
• Hierarchical Scoring Architecture: The development of a flexible scoring system that allows for:
  • A summated total score (via domain-level super-items).
  • Specific sub-scales for neurological and autonomic symptoms.
  • Individual domain scales.

4. Results

• Initial Findings: The Phase 1 data ($n=721$) revealed various item anomalies and inter-item dependencies, necessitating structural changes. Notably, the frequency and severity response structures replicated each other closely, suggesting redundancy that could be streamlined.
• Response Format: Analysis indicated that a four-point scale provided a better fit for the data than the initial five-point scale, likely due to improved discrimination between response categories.
• Validation Outcomes: The revised instrument, tested on the validation sample ($n=354$), demonstrated:
  • Improved Response Structure: Better alignment with Rasch model assumptions.
  • Robust Functionality: All domains satisfied assumptions for unidimensionality, internal reliability, and item fit.
  • Scalability: The domain-level super-items successfully functioned to create a valid total score alongside specific sub-scales for neurological and autonomic domains.

5. Significance

The TIMES instrument represents a critical advancement in ME/CFS research and clinical management. By satisfying rigorous Rasch model assumptions, it provides a stable and valid metric for quantifying symptom severity. This allows for:

• Standardized Measurement: Facilitating more accurate comparisons across clinical trials and observational studies.
• Precision Medicine: Enabling clinicians to track specific symptom clusters (e.g., autonomic vs. neurological) rather than relying on a global, non-specific fatigue score.
• Patient-Centered Care: The inclusion of patient advisory groups in the development phase ensures the tool captures the lived experience of the disease, enhancing its ecological validity.

In conclusion, the TIMES scale offers a scientifically rigorous, psychometrically sound tool that addresses the historical lack of validated symptom assessments in ME/CFS, paving the way for more effective treatment evaluation and disease monitoring.