The quality and reliability of short videos about External Counterpulsation on TikTok: a cross-sectional study

This cross-sectional study reveals that EECP-related videos on TikTok generally exhibit low-to-moderate informational quality and limited visibility, with user engagement metrics showing weak or negative correlations with content reliability.

The Gist

Imagine you walk into a massive, noisy digital town square called TikTok. In this square, people are shouting about everything from cooking recipes to how to fix a leaky faucet. Now, imagine there's a specific, somewhat complicated medical treatment called EECP (Enhanced External Counterpulsation). Think of EECP like a specialized, high-tech massage for your heart that helps blood flow better. It's a real, proven therapy, but it's not as famous as "take an aspirin" or "get a stent."

This study is like a team of detectives (the researchers) going into that town square to see:

1. How many people are actually talking about this heart massage?
2. Are they telling the truth and giving good advice?
3. Does the loudest voice (the most popular video) mean the best advice?

Here is what they found, broken down into simple stories and analogies:

1. The "Short-Form" Problem

The Analogy: Imagine trying to explain how to build a complex house using only a 30-second tweet. You can say "Build a house," but you can't explain the plumbing, the foundation, or the safety codes.

The Finding: The researchers found that videos about EECP were generally short and simple. Because the platform forces videos to be quick, creators often skip the boring but important details like who should get the treatment, how it works, or what the risks are.

• Result: The videos were like "teaser trailers" for a movie. They looked exciting, but they didn't give you the full story. The quality of information was low to medium.

2. The "Popularity Contest" Trap

The Analogy: Think of a carnival. The booth with the loudest music, the biggest balloons, and the most people cheering might be selling a cheap, sugary candy. The booth with the quiet, serious scientist explaining how to cure a disease might have a long line of people waiting to listen, but no one is cheering.

The Finding: The study discovered a strange disconnect.

• High Quality = Low Popularity: Videos that were accurate, detailed, and written by real heart doctors often got very few "Likes" or comments.
• Low Quality = High Popularity: Videos that were flashy, emotional, or made by regular people (without medical training) often went viral.
• The Takeaway: Just because a video has a million likes doesn't mean it's medically accurate. In fact, the most popular videos were often the least reliable.

3. The "Time is Quality" Rule

The Analogy: If you want to explain a complex recipe, a 10-second video will just show you the finished cake. A 2-minute video can show you how to mix the batter, preheat the oven, and avoid burning it.

The Finding: The researchers found a clear rule: Longer videos were better.

• Videos that lasted longer (even if they were still "short" by TV standards) managed to explain the medical details better.
• The platform's obsession with "snackable" content (very short videos) actually hurt the quality of medical advice. It's hard to explain a complex heart therapy in 15 seconds without leaving out the most important parts.

4. The "Hidden Gem" Problem

The Analogy: Imagine a library where 90% of the books are about "How to Bake Cookies" (common treatments), and only 2 books are about "Advanced Heart Surgery" (EECP). Even if the 2 books are the most important ones, you might never find them because they are buried in the back.

The Finding: Compared to videos about common heart treatments (like stents or bypass surgery), videos about EECP were rare. They were harder to find, and fewer people watched them. This means that even though EECP is a valid treatment, the public isn't seeing enough good information about it.

5. Who is Speaking?

The Analogy: In this town square, you have Expert Chefs (real heart doctors) and Home Cooks (regular people).

• The Expert Chefs were writing the most accurate recipes, but they were speaking quietly.
• The Home Cooks were shouting their personal stories, which were fun to listen to but sometimes missing key safety steps.

The Finding: Videos made by real heart specialists had higher quality scores. However, the videos made by patients or general users often got more attention because they told emotional stories. The platform's algorithm (the robot that decides what you see) seemed to prefer the emotional stories over the expert advice.

The Bottom Line

This study is a warning label for anyone using TikTok to learn about complex heart treatments.

• Don't trust the "Likes": A viral video isn't necessarily a good doctor.
• Beware of the "Short": If a video is too short, it's probably missing the most important details.
• Look for the Experts: Real doctors are there, but they are often drowned out by the noise of the crowd.

The Final Message: Short-video platforms are great for getting your attention, but they are terrible at teaching you complex medical science. If you are looking for serious health advice, you need to look deeper than the "For You" page.

Technical Summary

1. Problem Statement

Short-video platforms (e.g., TikTok/Douyin) have become primary sources of health information for the public. However, the structural constraints of these platforms—such as short duration limits, algorithm-driven content prioritization, and an emphasis on user engagement—may hinder the dissemination of complex, evidence-based medical information.

• Specific Gap: While general health information quality has been studied, there is a lack of data regarding Enhanced External Counterpulsation (EECP), a non-invasive therapy for coronary heart disease (CHD) and refractory angina.
• Research Question: What is the informational quality, visibility, and user engagement of EECP-related content on short-video platforms, and how does it compare to other CHD treatments?

2. Methodology

The study employed a cross-sectional content analysis design.

• Data Collection:
  • Platform: A major short-video platform (TikTok/Douyin).
  • Sample: 141 EECP-related videos and 142 videos covering other CHD treatments (control group).
  • Inclusion Criteria: Videos directly relevant to EECP with substantive information (narration, text, or captions) allowing for structured scoring.
  • Exclusion Criteria: Duplicates, non-informative clips, and content unrelated to EECP.
• Uploader Classification: Videos were categorized by uploader source: Cardiology specialists, non-cardiology medical professionals, nursing professionals, general users/patients, and commercial accounts.
• Quality Assessment Instruments: Two medically trained reviewers independently scored videos using four validated tools:
  1. Global Quality Scale (GQS): 5-point scale for overall educational quality.
  2. JAMA Benchmark Criteria: 4-point scale (Authorship, Attribution, Disclosure, Currency).
  3. Modified DISCERN (mDISCERN): 5-point binary scale for reliability of treatment information.
  4. Video Information and Quality Index (VIQI): 20-point scale for flow, accuracy, and presentation.
• Statistical Analysis:
  • Descriptive statistics for video characteristics and engagement (likes, comments, shares, collections).
  • Non-parametric tests (Mann–Whitney U, Kruskal–Wallis) for group comparisons.
  • Spearman's rank correlation and linear regression to analyze associations between video parameters (duration, source) and quality scores.
  • Inter-rater reliability was confirmed using Intraclass Correlation Coefficients (ICC).

3. Key Contributions

• First Comprehensive Evaluation of EECP on Social Media: This is the first study to systematically assess the quality and visibility of EECP content on short-video platforms.
• Multi-Dimensional Assessment: Utilized four distinct, validated instruments to provide a robust, multi-faceted evaluation of informational quality, moving beyond single-metric assessments.
• Comparative Analysis: Directly compared EECP content against other CHD treatments to identify relative visibility and engagement disparities.
• Decoupling Quality from Popularity: Provided empirical evidence that user engagement metrics (likes, comments) are poor proxies for medical information accuracy or completeness in this context.

4. Key Results

A. Informational Quality

• Overall Quality: EECP videos demonstrated low-to-moderate quality across all four assessment tools.
  • GQS Mean: 2.94 (Range 2–4)
  • mDISCERN Mean: 2.22 (Range 1–4)
  • JAMA Mean: 2.07 (Range 1–4)
  • VIQI Mean: 7.32 (Range 5–11)
• Content Deficiencies: Most videos lacked critical details regarding therapeutic indications, mechanisms of action, patient selection criteria, risks, and evidence-based outcomes. Authorship transparency and conflict of interest disclosures were frequently absent.

B. Video Characteristics & Quality Correlation

• Video Duration: There was a strong, positive correlation between video length and informational quality scores ($p < 0.0001$). Longer videos allowed for better context, mechanism explanation, and clinical nuance.
• User Engagement: Engagement metrics (likes, comments, shares) showed weak or negative correlations with quality scores. High-quality videos did not necessarily generate high engagement.

C. Uploader Source Analysis

• Professional vs. Non-Professional: Videos by cardiology professionals (70.9% of the sample) achieved higher quality scores but did not consistently receive higher engagement than videos by general users or commercial accounts.
• Engagement Paradox: Videos by patients/general users or commercial accounts often had lower quality scores but attracted higher user interaction, likely due to emotional storytelling or marketing narratives.

D. Comparison with Other CHD Treatments

• Visibility: EECP-related videos were less prevalent than videos discussing other CHD treatments.
• Engagement: EECP videos received significantly lower user engagement (likes, comments, shares) compared to other CHD treatment videos.
• Quality: The relationship between video duration and quality was consistent across both EECP and other CHD videos, suggesting a platform-wide structural limitation.

5. Significance and Implications

• Structural Disadvantage for Complex Therapies: The study concludes that short-video formats are structurally ill-suited for complex, non-mainstream therapies like EECP. The need for nuance (indications, mechanisms, limitations) conflicts with the platform's preference for brevity and high engagement.
• Public Health Risk: The misalignment between popularity and quality poses a risk where patients may be exposed to incomplete or misleading information about effective treatments, potentially influencing healthcare decisions based on engagement rather than evidence.
• Recommendations:
  • Clinicians/Institutions: Need to create targeted, longer-form, or series-based content to overcome platform constraints.
  • Platforms: Algorithmic adjustments may be needed to prioritize evidence-based medical content over purely engagement-driven narratives.
  • Public: Users should be cautioned against relying solely on short-video platforms for complex medical information.

Conclusion: EECP content on short-video platforms suffers from limited visibility and modest informational quality. There is a significant disconnect between the educational value of the content and its popularity, suggesting that clinically relevant but complex therapies are disadvantaged in current digital health communication ecosystems.