📄 medicine

Quality and reliability of Chinese short-form health information about hypertension and type 2 diabetes on TikTok: a comparative cross-sectional study

This comparative cross-sectional study of 300 Chinese TikTok videos reveals that health information on hypertension and type 2 diabetes is generally of low quality, with medical professionals producing significantly better content than individual users and platform popularity proving to be an unreliable indicator of information reliability.

Original authors: Xingwang Qiu, Xia Luo, Xiaotao Xu, Shanmei Zhou, Shixuan Yuan, Jin Zhang, Hua Guan

Published 2026-06-24

📖 4 min read☕ Coffee break read

CC BY 4.0

Original authors: Xingwang Qiu, Xia Luo, Xiaotao Xu, Shanmei Zhou, Shixuan Yuan, Jin Zhang, Hua Guan

Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). ✨ This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer

The Big Picture: A Digital Marketplace of Health Advice

Imagine TikTok as a massive, bustling digital marketplace. Instead of selling fruits or clothes, people are selling health advice about two very common conditions: high blood pressure (hypertension) and type 2 diabetes.

The researchers wanted to know: Is the food being sold here fresh and nutritious, or is it junk? They specifically looked at 300 Chinese videos (150 about blood pressure, 150 about diabetes) to see how good the information was, who was selling it, and whether the "most popular" videos were actually the "best" ones.

The Taste Test: How They Measured Quality

To judge these videos, the researchers didn't just guess. They used three specific "taste tests" (scoring tools) to grade the content:

The "Overall Vibe" Test (GQS): Does the video look professional? Is the message clear? Is it actually useful? (Scored 1 to 5).
The "Trustworthiness" Test (mDISCERN): Did the creator say where they got their info? Did they admit if they weren't sure about something? Did they stay neutral, or were they biased? (Scored 1 to 5).
The "ID Card" Test (JAMA): Did the video tell you who made it, when it was made, and where the info came from? (Scored 0 to 4).

What They Found: The Results

1. The Food is Mostly "Fast Food" Quality

The overall quality of the videos was below average.

The Analogy: Imagine walking into a cafeteria expecting a chef-prepared meal, but most of the food is just pre-packaged snacks.
The Score: The average video got a "C" or "D" grade. They were okay for entertainment, but not reliable enough to be your primary doctor.
The Transparency Problem: Most videos failed the "ID Card" test. They rarely told you who made them or when the info was updated. It's like eating a mystery meat stew without knowing the ingredients or the expiration date.

2. The "Blood Pressure" Videos Were Slightly Better Than "Diabetes" Videos

The Finding: Videos about high blood pressure scored higher on quality and reliability than those about diabetes.
The Analogy: Think of High Blood Pressure advice as a simple recipe: "Eat less salt, walk more." It's easy to explain in 30 seconds.
The Contrast: Type 2 Diabetes is like a complex, multi-course meal with many variables (carbs, insulin, foot care, different meds). Trying to squeeze that into a short video often leads to confusion or oversimplification. The researchers found that diabetes videos were more likely to be misleading or incomplete.

3. Who is Cooking the Food Matters Most

The Finding: Videos made by medical professionals (doctors, nurses) were significantly better than those made by regular people or companies.
The Analogy:
- Medical Pros: Like a trained chef. Their videos were the most reliable, though even they sometimes cut corners to make the video "fun" or short.
- Commercial Companies: Like a fast-food chain trying to sell a "miracle diet." These had the lowest quality. They often disguised marketing as education, pushing products that might not work.
- Individual Users: Like home cooks sharing recipes. Some were good, but many lacked the training to ensure the advice was safe.

4. The "Popularity Trap"

The Finding: The researchers checked if the videos with the most "Likes," "Shares," and "Comments" were the best ones. They were not.
The Analogy: Imagine a loud, flashy street performer drawing a huge crowd. Just because the crowd is huge doesn't mean the performer is telling the truth or giving good advice.
The Reality: On TikTok, the algorithm (the robot that decides what you see) loves drama, emotion, and simple stories. A video saying "I cured my diabetes with this one berry!" might get 1 million likes, while a boring video saying "Take your meds and check your sugar daily" might get 100. Popularity does not equal accuracy.

The Bottom Line

The study concludes that while TikTok is a great place to start learning about health, it is currently a risky place to make medical decisions.

The Good News: Doctors are starting to make videos, and they are the best source.
The Bad News: There is too much "junk food" content (especially for diabetes), and the platform's "popularity contest" often pushes bad advice to the top.

The Takeaway for You: If you see a health video on TikTok, don't just trust it because it has a million likes. Check if a doctor made it, look for the "ID card" (sources and dates), and remember that the most popular video isn't always the most truthful one.

Technical Summary: Quality and Reliability of Chinese Short-Form Health Information on Hypertension and Type 2 Diabetes on TikTok

Problem Statement
Hypertension and type 2 diabetes are highly prevalent chronic non-communicable diseases globally, particularly in China, where comorbidity is rising. Effective self-management relies heavily on access to accurate health information. While TikTok has emerged as a primary source of health information due to its massive user base and algorithmic reach, the platform's low barrier to entry and lax review processes have led to significant variability in content quality. Existing literature indicates that health information on social media is often of low quality and poor reliability, yet there is a lack of comparative research specifically addressing the information ecosystems of these two major chronic conditions within the Chinese context. This study addresses the gap by systematically evaluating and comparing the quality, reliability, and transparency of Chinese short-video health content regarding hypertension and type 2 diabetes on TikTok.

Methodology
The study employed a quantitative, observational comparative cross-sectional design. Data collection occurred between February and May 2026.

Sampling: Researchers utilized a newly registered TikTok account with no browsing history to minimize algorithmic bias. They searched using six core keywords ("hypertension," "lower blood pressure," "high blood pressure," "type 2 diabetes," "lower blood sugar," "high blood sugar") and selected the top 150 videos for each condition based on the platform's default "comprehensive sorting." This yielded a final sample of 300 videos (150 per condition).
Exclusion Criteria: Duplicate uploads, videos lacking substantive content (e.g., music or ads only), videos naming the disease without providing information, and non-Chinese language videos were excluded.
Data Extraction: Two trained researchers independently and blindly extracted data on video duration, upload year, uploader identity (medical professionals, news media, commercial organizations, individual users), core themes, and user interaction metrics (likes, comments, shares, collections).
Quality Assessment: Three validated instruments were used:
1. Global Quality Score (GQS): A 5-point Likert scale assessing overall quality and utility.
2. Modified DISCERN (mDISCERN): A 5-point scale evaluating reliability, source transparency, and balance.
3. Journal of the American Medical Association (JAMA) Benchmark Criteria: A 4-point scale assessing author identity, attribution, disclosure, and timeliness.
Statistical Analysis: Inter-rater reliability was assessed using Cohen's Kappa. Group comparisons utilized the Mann–Whitney U test and Kruskal–Wallis test. Spearman correlation analyzed relationships between video characteristics and quality. Multiple linear regression identified independent predictors of video quality (GQS).

Key Contributions

Comparative Analysis: This is one of the first studies to directly compare the information ecosystems of hypertension and type 2 diabetes on a major short-video platform within China, revealing distinct differences in content quality and reliability between the two conditions.
Multidimensional Evaluation: The study applies a robust, three-tool framework (GQS, mDISCERN, JAMA) to assess overall quality, source reliability, and transparency simultaneously.
Predictive Modeling: It identifies uploader identity and disease type as significant independent predictors of content quality, providing empirical data on the drivers of misinformation.
Algorithmic Insight: The study quantifies the "quality-popularity paradox," demonstrating that high user engagement metrics do not correlate strongly with information quality.

Results

Overall Quality: The overall quality of health information on TikTok for both conditions was found to be below the medium level. Median GQS scores were 3.00 for hypertension and 3.00 for type 2 diabetes (with interquartile ranges indicating variability), and median mDISCERN scores were 2.00 for both. JAMA scores were consistently low (median 2.00), indicating poor transparency regarding authorship and sources.
Disease-Specific Differences: Videos on hypertension scored significantly higher than those on type 2 diabetes in both GQS ( $p < 0.001$ ) and mDISCERN ( $p = 0.003$ ). However, JAMA scores did not differ significantly between the two ( $p = 0.927$ ).
Uploader Impact: Medical professionals produced the highest quality content across all metrics. Videos by commercial organizations scored the lowest. Individual users scored significantly lower than medical professionals but higher than commercial organizations.
Content Themes: For hypertension, "lifestyle intervention" videos achieved the highest quality scores. For type 2 diabetes, "disease monitoring" and "complication prevention" scored highest, while "drug treatment" and "experience sharing" scored lower.
Correlations: User interaction metrics (likes, comments, shares) were strongly correlated with each other but showed only weak to modest correlations with quality scores ( $r = 0.27–0.70$ ), confirming that popularity is not a proxy for reliability. Video duration was a weak but significant positive predictor of GQS ( $\beta = 0.091, p = 0.025$ ).
Regression Findings: Multiple linear regression confirmed that videos uploaded by medical professionals ( $\beta = 0.635, p < 0.001$ ) and those concerning hypertension ( $\beta = 0.147, p < 0.001$ ) were independent predictors of higher quality. Commercial organization uploads were a negative predictor ( $\beta = -0.225, p < 0.001$ ).

Significance and Claims
The paper claims that the current digital health information ecosystem for chronic diseases on TikTok is characterized by suboptimal quality and inadequate reliability, posing potential risks to patient self-management.

Clinical and Public Health Implications: The findings suggest that while TikTok has potential for health education, the current content requires substantial improvement in reliability and source transparency. The study highlights that the complexity of type 2 diabetes management makes it more susceptible to low-quality, misleading content compared to the more standardized management of hypertension.
Platform Governance: The authors argue that short-video platforms must implement hierarchical review mechanisms and preferential recommendation algorithms for content from certified medical professionals. They also call for stricter labeling and oversight of commercial marketing to prevent the spread of profit-driven misinformation.
Professional and Patient Roles: The study advocates for encouraging clinicians to produce evidence-based public education materials and promoting digital health literacy among patients to help them navigate unreliable sources.
Future Directions: The authors suggest that future research should focus on longitudinal monitoring of content quality, cross-platform comparisons, and the development of AI-driven tools for automated quality assessment.

The study concludes that creating a safer digital health environment requires collaborative efforts from platform providers, medical professionals, policymakers, and patients to ensure that health information disseminated on short-video platforms is accurate, reliable, and beneficial.