Feasibility of at-home online cognitive screening prior to primary care wellness visits for older adults.

This study demonstrates that self-administered online cognitive screening prior to primary care visits is acceptable to older adults and correlates moderately with in-clinic assessments, though completion rates suggest a need for additional support to fully integrate this method into routine care.

The Gist

Imagine your brain is like a high-performance car engine. As we get older, just like any car, it needs regular check-ups to make sure everything is running smoothly. For a long time, getting a "brain check-up" meant driving to a doctor's office, sitting in a waiting room, and doing a series of paper-and-pencil puzzles while a nurse watched you. This is often stressful, time-consuming, and many people skip it.

This new study asks a simple question: What if we could do this brain check-up from the comfort of our own living rooms, on our own phones or computers, before we even walk into the doctor's office?

Here is the story of how they tested this idea, explained in plain English.

The Problem: The "Traffic Jam" at the Doctor's Office

Right now, our healthcare system is like a busy highway with too many cars (older adults) and not enough lanes (doctors' time). About 90% of people with early signs of memory trouble (called Mild Cognitive Impairment) are never diagnosed because there isn't enough time in a regular doctor's visit to test them properly.

Doctors are starting to use new "fuel gauges" (blood tests) to detect Alzheimer's early, but those tests are expensive and only make sense if you already know something is wrong with the engine. We need a better, faster way to find out if the engine is sputtering in the first place.

The Experiment: The "At-Home Brain Test"

The researchers tried a new tool called BOCA (Boston Cognitive Assessment). Think of BOCA as a 10-minute interactive video game that tests your memory, attention, and problem-solving skills.

Here is how they set up the experiment:

1. The Invitation: They invited 32 older adults (ages 55–85) who were already scheduled for their yearly doctor's check-up.
2. The Mission: Instead of waiting until they got to the clinic, these patients were sent a link to take the BOCA test at home, 1 to 4 weeks before their appointment. They could use their own smartphone, tablet, or computer.
3. The Safety Net: When they finally arrived at the doctor's office, they took two more tests: a quick digital test supervised by the doctor, and the traditional paper "MoCA" test (the current gold standard) given by a researcher. This was to make sure the home test was accurate.

The Results: Did It Work?

1. The "Completion Rate" (Did people actually do it?)
Imagine you ask 100 people to fill out a form at home. You hope 80 of them do it. In this study, about 78 out of 100 people finished the test.

• Verdict: It was a success, but not perfect. About 20% of people didn't finish. Some said they were too busy, some had tech trouble, and some just forgot.
• Lesson: While people can do it, they might need a little more help (like a friendly reminder call or a family member's nudge) to make sure everyone finishes.

2. The "Comfort Factor" (Did people like it?)
When the researchers asked the participants what they thought, the results were clear:

• The Crowd Favorite: Most people (50%) preferred doing the test at home.
• The Feeling: 78% said they felt more relaxed and comfortable at home than in the clinic.
• The Surprise: Even though they preferred home, 40% said they wouldn't mind doing both—a quick one at home to get a baseline, and a supervised one at the doctor's to confirm.
• The Tech: Most people used their smartphones. It wasn't as hard as they thought!

3. The "Accuracy Check" (Was the home test real?)
The researchers compared the home test scores with the in-clinic paper test.

• The Scoreboard: The home test scores matched up pretty well with the in-clinic scores. It was like taking a practice quiz at home and getting a similar grade to the final exam at school.
• The Catch: The home test was good at spotting people who were fine, but it sometimes struggled to perfectly distinguish between "slightly worried" and "definitely impaired." It's a great first filter, but not a final diagnosis.

The Big Takeaway: A New Way to Drive

This study is like testing a new GPS navigation system for brain health.

• The Good News: It proves that older adults are willing and able to take a brain test at home. It's less stressful, and it saves time in the doctor's office.
• The Reality Check: We can't just send a link and hope for the best. To make this work for everyone, we need a "co-pilot"—someone (a family member, a nurse, or a tech support person) to help people get started if they get stuck.
• The Future: If we can get this right, doctors could get a "brain health report" before the patient even walks through the door. This would allow them to focus their time on the people who actually need help, rather than wasting time on routine checks for everyone.

In short: Doing a brain check-up at home is a promising idea that people like. It's not quite perfect yet, but with a little more support, it could become a standard part of keeping our brains healthy as we age.

Technical Summary

1. Problem Statement

The primary care sector faces a critical challenge in detecting cognitive impairment and dementia early. Approximately 90% of Mild Cognitive Impairment (MCI) cases remain undiagnosed in Medicare beneficiaries, with disparities affecting Black and Hispanic/Latino populations. Current paper-based screening tools often lack sensitivity for MCI, creating a bottleneck for identifying candidates for newer, FDA-approved plasma biomarkers. Furthermore, primary care providers face severe time constraints, making in-clinic administration of comprehensive cognitive tests difficult. While digital assessments exist, there is a need to validate unsupervised, remote (at-home) digital screening tools that can be completed by older adults prior to their annual wellness visits to streamline the diagnostic workflow.

2. Methodology

Study Design:
A feasibility and acceptability study conducted across three primary care clinics in Rhode Island involving 32 older adults (aged 55–85).

Participants:

• Recruitment: 48 individuals were screened; 37 enrolled, with 32 completing the study (15.6% attrition).
• Demographics: Mean age 68 (SD 6.6); 56% female; 84% White, 16% Black; Mean education 14.7 years.
• Inclusion/Exclusion: Fluent in English, no existing dementia/neurological diagnosis, telephone MoCA score ≥13, no acute psychiatric illness or substance use disorder.

Intervention Protocol:

1. Remote Assessment (At-Home): Participants completed the Boston Cognitive Assessment (BOCA) on personal devices (smartphone, tablet, or computer) 1–4 weeks prior to their Primary Care Provider (PCP) visit.
   • BOCA: A 10-minute, self-administered, 30-point global cognition test covering orientation, recall, executive function, visuospatial ability, attention, and language.
   • Reliability Check: BOCA was administered twice (T1: 1–4 weeks pre-visit; T2: day of visit) to assess test-retest reliability.
2. In-Clinic Assessment: During the PCP visit, participants completed:
   • DCR (Linus Health Digital Clock and Recall): A 3–5 minute supervised digital test.
   • MoCA (Montreal Cognitive Assessment): The standard paper-based reference standard administered by research staff.
3. Data Collection: Participants completed a survey regarding acceptability, preference, and usability.

Analysis:

• Feasibility: Measured by completion rates against an 80% benchmark.
• Validity: Test-retest reliability (BOCA T1 vs. T2), convergent validity (Spearman's correlation between BOCA, DCR, and MoCA), and diagnostic accuracy (Area Under the Curve [AUC] analysis using MoCA <26 as the cutoff for impairment).

3. Key Contributions

• Validation of Remote Workflow: Demonstrated the feasibility of integrating a self-administered digital cognitive test (BOCA) into the routine primary care workflow prior to the actual appointment.
• Patient-Centric Design: Provided empirical data on patient preferences, showing a strong preference for at-home testing over in-clinic testing.
• Preliminary Psychometrics: Established initial test-retest reliability and convergent validity for the BOCA in a primary care setting, distinct from previous memory clinic validations.
• Recruitment Insights: Identified that direct PCP referrals are significantly more effective than passive recruitment (mail/MyChart) for engaging older adults in cognitive screening studies.

4. Results

Feasibility & Completion Rates:

• T1 (Pre-visit) Completion: 78.5% (25/32 participants). This fell slightly short of the 80% benchmark.
• T2 (Day-of-visit) Completion: 66.7%.
• Barriers: Reasons for non-completion included time commitment, technical difficulties, and lack of support.

Acceptability:

• Preference: 50% preferred at-home testing; 40% preferred a hybrid (both at-home and in-clinic); only 10% preferred in-clinic only.
• Comfort: 78% felt more comfortable testing at home.
• Perceived Difficulty: In-clinic testing was rated as more difficult than at-home testing.
• Device Usage: At-home testing was primarily conducted on smartphones (48%), followed by computers (28%) and tablets (24%).

Validity & Psychometrics:

• Test-Retest Reliability: BOCA showed good reliability between T1 and T2 ($r = .81$, 95% CI [.54 - .93]).
• Convergent Validity:
  • BOCA correlated moderately with MoCA ($r = .59$, $p < .001$).
  • BOCA correlated strongly with DCR ($r = .71$, $p < .001$).
  • DCR correlated strongly with MoCA ($r = .76$, $p < .001$).
• Diagnostic Accuracy:
  • BOCA AUC for distinguishing cognitive impairment (MoCA <26) was 0.80 (95% CI [0.60-1.0]).
  • A preliminary cutoff score of 24 on the BOCA yielded 91% sensitivity and 71% specificity.
  • Note: The study noted potential ceiling effects due to the high-functioning sample and limited positive predictive power in low-prevalence settings.

5. Significance and Implications

• Workflow Optimization: The study supports a "flipped" model where cognitive screening occurs remotely, allowing PCPs to review results before the visit. This enables targeted follow-up and reduces in-clinic time burdens.
• Scalability: With 88% of US older adults using the internet, remote digital screening is a scalable solution for the growing aging population.
• Implementation Requirements: The 78.5% completion rate suggests that while the tool is acceptable, successful routine implementation requires additional support infrastructure (e.g., dedicated coordinators, family member assistance, or AI-driven technical support) to overcome the 20% dropout rate.
• Clinical Impact: The study successfully facilitated referrals to memory clinics for participants with low scores, demonstrating the potential for early detection and intervention.
• Limitations: The sample was geographically limited, highly educated, and less racially diverse than state averages, which may limit generalizability. Larger, more diverse studies are needed to validate cutoff scores across different demographics.

Conclusion:
Remote, unsupervised cognitive screening using the BOCA is feasible and highly acceptable to older adults in primary care. While completion rates were slightly below the target, the approach offers a promising pathway to address the "silent" epidemic of undiagnosed cognitive impairment, provided that supportive workflows are established to assist patients with remote completion.