Development and validation of the artificial intelligence literacy scale for medical students (AILS-MS)
This study developed and validated a 20-item, four-dimensional scale (AILS-MS) to assess AI literacy among medical students, integrating UNESCO's competency framework with medical education needs to support curriculum reform and competency-based assessment.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
In the modern world, artificial intelligence has moved from the realm of science fiction into the daily rhythm of healthcare. It helps doctors read X-rays, predicts which patients might get sick, and even assists in discovering new medicines. As these tools become more common, a new kind of skill is becoming just as important as knowing anatomy or how to prescribe medication. This skill is called AI literacy. It is not about knowing how to build a computer, but rather about understanding how these systems work, knowing when to trust them, and recognizing when they might be wrong. For the doctors of tomorrow, this literacy is a matter of safety. If a future physician cannot tell the difference between a helpful AI suggestion and a dangerous error, or if they rely on a machine so much that they forget their own judgment, the results could harm patients. The question facing medical schools today is how to teach this skill and, more importantly, how to measure whether students have actually learned it.
Until now, there has been no standard way to test this specific knowledge for medical students in China. Existing tests were designed for general college students or for doctors in Western countries, where the rules and culture are different. To fill this gap, a team of researchers at Chongqing Medical University set out to build a new measuring tool from the ground up. They wanted a test that would fit the unique needs of future doctors, one that accounts for the high stakes of patient care and the specific laws and ethics of the Chinese healthcare system. Their goal was to create a scale that could tell educators exactly how well a student understands the role of artificial intelligence in medicine, from the technical details to the moral implications.
The researchers began by gathering ideas from many different places. They looked at existing studies, interviewed medical students and experts, and consulted with a panel of specialists in fields ranging from clinical medicine to medical ethics. This process helped them identify the most important areas of knowledge. They realized that being "AI literate" in medicine is not just one single skill. Instead, it is made up of four distinct parts. First, there is the ability to understand and use the technology itself, such as knowing how to ask the right questions to get useful answers from a computer. Second, there is the human side, which involves keeping a clear head and not letting the machine take over the doctor's own thinking. Third, there is the ethical layer, which covers privacy, fairness, and the rules about how data should be handled. Finally, there is the aspect of learning, which is about using these tools to help students grow and learn new things throughout their careers.
To turn these ideas into a real test, the team created a list of twenty specific questions. They then asked hundreds of medical students from three different universities to take the survey. The researchers split the group in two: one group helped them figure out how the questions fit together, and the other group helped them confirm that the structure was solid. Through careful statistical analysis, they found that the twenty questions naturally grouped into the four categories they had predicted. The test proved to be reliable, meaning that if a student took it again, they would likely get a similar score, and the questions consistently measured what they were supposed to measure. The final result is a twenty-item scale that covers the full spectrum of AI literacy, from technical know-how to ethical responsibility.
The study found that this new tool, which the researchers named the Artificial Intelligence Literacy Scale for Medical Students, works well. It successfully distinguishes between different levels of understanding and provides a clear picture of a student's strengths and weaknesses. The four dimensions it measures—technology and application, humanistic values, ethics and fairness, and AI-enhanced learning—offer a complete view of what it means to be ready for an AI-driven future in medicine. The researchers suggest that schools can now use this scale to check how well their current teaching is working and to design better courses. By having a reliable way to measure these skills, medical educators can ensure that the next generation of doctors is not just familiar with artificial intelligence, but is truly prepared to use it wisely, safely, and ethically in the care of their patients.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.