Design and evaluation of a mobile app for artificial intelligence education among healthcare students: A before-and-after study
This before-and-after study demonstrates that the Persian-language mobile application AIMedEdu significantly improved healthcare students' perceived medical AI readiness and received excellent usability ratings, though future research is needed to confirm long-term educational effectiveness and generalizability.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
Artificial intelligence is rapidly becoming a standard part of modern healthcare, appearing in everything from tools that help doctors read X-rays to systems that predict patient risks. As these technologies become more common, the people who will use them in the future—medical and health students—need to understand not just how to operate them, but how to think critically about them. They must learn to recognize the limitations of these systems, spot potential errors or biases, and navigate the ethical questions that arise when a machine helps make a life-or-death decision. Currently, many students feel unprepared for this shift. They often hold positive views about the potential of artificial intelligence but admit they lack the structured knowledge to use it safely and effectively. This gap between optimism and readiness creates a need for new ways to teach these complex skills.
To address this need, researchers at Mashhad University of Medical Sciences in Iran developed a mobile application called AIMedEdu, designed specifically to teach artificial intelligence concepts to healthcare students in their native Persian language. The team did not simply guess what content to include; they first conducted extensive research to determine exactly what students needed to learn and how they preferred to learn it. This groundwork led to a framework of eleven distinct educational topics, ranging from basic concepts and data science to clinical applications, ethics, and communication. The resulting app was built to be flexible, allowing students to study offline without an internet connection, track their progress, and take interactive quizzes. The researchers then tested this tool with ninety-seven students over a thirty-day period to see if it actually improved their confidence and understanding.
The results of the study were striking. Before using the app, the students' average score on a test measuring their perceived readiness to work with medical artificial intelligence was relatively low, sitting around forty-five points out of a possible one hundred ten. After spending a month working through the app's modules, their average score jumped to nearly one hundred eight. This massive increase suggests that the students felt significantly more prepared to engage with artificial intelligence in their future careers. The improvement was not limited to just one area; it was seen across all four key areas measured: their understanding of the concepts, their belief in their ability to use the tools, their vision for how these tools fit into medicine, and their grasp of the ethical implications. The researchers noted that the students' scores after the training were so high that they clustered near the top of the scale, indicating that the app successfully brought almost everyone to a high level of perceived competence.
Beyond the educational gains, the app itself was highly successful in terms of user experience. When the students were asked to rate how easy and pleasant the application was to use, they gave it an exceptional score, averaging over ninety-one out of one hundred. This rating, known as a usability score, places the app in the top tier of digital tools, suggesting it was intuitive and well-designed. The students found the application easy to learn, felt confident using it, and did not feel that it required extensive prior knowledge to get started. A panel of five experts, including specialists in medical education and artificial intelligence, also reviewed the app before the students used it and gave it a similarly high rating, confirming that the content was accurate and the structure was sound.
One of the most interesting findings was that the app worked equally well for everyone, regardless of their background. The researchers looked to see if students who were already familiar with artificial intelligence tools learned more than those who were new to the field, or if students in different years of their education or different medical specialties responded differently. They found no significant differences. Whether a student was studying physiotherapy, optometry, or health information technology, and whether they had used artificial intelligence before or not, they all showed similar, substantial improvements. This suggests that the app's design was effective at bridging the knowledge gap for a diverse group of learners, making it a potentially valuable tool for medical education across different disciplines.
Despite these positive outcomes, the researchers are careful to note the limits of what this study proves. Because the study did not include a control group of students who did not use the app, it is impossible to say with absolute certainty that the app alone caused the improvement, though the results are strongly associated with its use. Furthermore, the test measured how prepared the students felt rather than testing their actual ability to solve complex problems or their objective knowledge. The fact that scores were so high after the training also means the test might have reached a point where it could no longer distinguish between very high levels of readiness. The researchers conclude that while the app is a promising and highly usable tool that boosts student confidence, future studies will need to use more rigorous methods and objective tests to confirm that this confidence translates into real-world skills and long-term retention.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.