Test-retest reliability of an ultra fast Continuous Visual Attention Test
This study confirms that the ultra-fast 90-second Continuous Visual Attention Test (CVAT) demonstrates good test-retest reliability and practical equivalence for most measures, including reaction time and variability, across both same-day and non-same-day assessments.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of a preprint that has not been peer-reviewed. It is not medical advice. Do not make health decisions based on this content. Read full disclaimer
The human mind is not a static machine; it is a dynamic system that must constantly balance speed, accuracy, and the ability to stay focused over time. To understand how well this system works, scientists have long relied on tests that ask people to watch a screen and react to specific shapes while ignoring others. These tests, known as continuous performance tests, measure more than just how fast a person can press a button. They reveal how steady that speed is, how often the person misses a target they should have hit, and how often they mistakenly press the button when they should have stayed still. For decades, the standard version of these tests has been a fifteen-minute ordeal. While effective, that length can be exhausting, leading to fatigue that clouds the results, especially in clinical settings where a doctor needs a quick, clear picture of a patient's attention span.
Researchers have recently developed a much shorter version of this test, one that takes only ninety seconds to complete. This ultra-fast version promises to offer the same insights without the fatigue, making it possible to run the test multiple times in a single visit or to use it with patients who struggle to sit still for long periods. However, a critical question remained unanswered: if you take this quick test twice, will it give you the same result? In the world of medical measurement, a tool is only useful if it is reliable. If a patient takes the test on Monday and again on Tuesday, the scores should be consistent enough to show whether their condition is improving or worsening, rather than just bouncing around randomly. Without proof of this stability, the short test remains a curiosity rather than a clinical tool.
A team of researchers at the Federal University of the State of Rio de Janeiro set out to answer this question. They recruited 224 volunteers, ranging in age from 18 to 60, to take the ninety-second visual attention test twice. The goal was to see how closely the scores from the first attempt matched the scores from the second. To ensure a robust picture, the team split the participants into two groups. One group took the test again on the very same day, with just a fifteen-minute break in between. The other group returned on a different day, with an average gap of nearly ten days between the two sessions. This design allowed the scientists to check if the test held up under the pressure of immediate repetition as well as over a slightly longer stretch of time.
The results were encouraging. When the researchers looked at the data, they found that the test was highly reliable for measuring how fast people reacted and how steady their reaction times were. These measures, which reflect alertness and the ability to maintain focus, showed a strong connection between the first and second attempts. Whether the volunteers took the test again on the same day or a week later, their speed and consistency remained remarkably stable. The test also proved reliable for measuring a specific type of error where a person presses the button when they shouldn't, known as a commission error. This suggests that the short test can effectively capture a person's ability to control their impulses, even when administered quickly.
However, the test was less consistent when it came to measuring the other type of error: missing a target that should have been hit. In the group that took the test twice on the same day, the number of missed targets varied too much between the first and second try to be considered reliable. This is likely because healthy people make very few mistakes on these tasks, creating a situation where the scores are so low that small changes look like big differences. In the group that returned on a different day, the results for missed targets were better, showing a moderate level of consistency. Despite this one limitation, the overall picture is clear: the ninety-second test is a stable and trustworthy tool for measuring reaction speed, consistency, and impulse control.
The researchers also checked if the scores from the first test were practically the same as the scores from the second, rather than just statistically related. They found that for every measure the test provided, the difference between the two attempts was so small that it would not matter in a real-world medical setting. A person's score did not drift significantly just because they took the test again. This means that if a doctor uses this test to monitor a patient's progress, they can be confident that a change in the score reflects a real change in the patient's attention, not just a fluke of the testing process.
This study confirms that the ultra-fast version of the visual attention test is a viable alternative to the longer, traditional versions. It offers a way to assess attention that is quick, resistant to fatigue, and reliable enough to be used repeatedly. For conditions where attention fluctuates rapidly or where patients cannot tolerate long testing sessions, this tool provides a practical solution. While it may not be the perfect instrument for tracking missed targets on the same day, its strength in measuring speed, consistency, and impulse control makes it a valuable addition to the toolkit for understanding how the human mind focuses and reacts.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.