Development and validation of a SHELL model-based risk assessment scale for anesthesia medication management: A cross-sectional study

In the operating room, the administration of anesthesia is a high-stakes ballet of precision, where a single misplaced dose can alter the course of a patient's life. The drugs involved—powerful painkillers, sedatives, and muscle relaxants—are essential for surgery, yet they carry a unique danger because they are often controlled substances that require strict oversight. For decades, hospitals have relied on checklists to ensure safety, asking staff to confirm that a label is present or that a double-check was performed. However, these lists often function like a simple inventory, verifying that parts exist without checking how well those parts work together. A policy might be perfect on paper, but fail in practice because the equipment is confusing, the room is too noisy, or the team is too tired to communicate clearly. To understand why errors happen, safety experts look at the entire system, not just the individual making the mistake. This approach considers five interacting elements: the rules and software, the physical tools and hardware, the environment where work happens, the knowledge and skills of the people, and the way those people interact with one another. When these elements clash, risks emerge that a simple checklist cannot see.

A team of researchers from hospitals in China set out to build a new tool designed to find these hidden risks before they cause harm. They focused on the management of anesthesia medications and developed a survey called the Anesthesia Medication Management Risk Assessment Scale. Instead of asking nurses to simply check boxes, this tool asks them to evaluate the quality of the connections between the five system elements. The researchers began by studying thousands of existing reports and interviewing dozens of nurses to understand the real-world challenges they face. They then gathered a panel of seventeen experts in anesthesia and nursing management to refine a long list of potential questions. Through two rounds of careful review, the experts helped narrow the list down to the most critical questions, ensuring the tool would accurately reflect the complexities of medication safety.

To test whether this new scale actually worked, the researchers distributed it to 771 anesthesia nurses across twenty-one different hospitals in China. They split these participants into two groups to ensure the results were robust. The first group helped the researchers discover the underlying structure of the tool, revealing that the questions naturally grouped into five distinct categories that matched the five system elements: the rules and procedures, the equipment and facilities, the physical workspace and safety culture, the individual knowledge and responsibility of the staff, and the teamwork and communication between colleagues. The second group was used to confirm that this structure held up under scrutiny. The results showed that the tool was highly reliable. When the same nurses took the test again two weeks later, their answers were consistent, proving the scale measured something stable and real. The internal consistency was exceptionally high, indicating that the questions worked together seamlessly to paint a clear picture of the safety environment.

The study found that the new scale successfully identified specific weaknesses in the system. For instance, a hospital might have excellent equipment and well-trained staff, but if the communication between team members is poor, the scale would flag that specific area as a risk. This is a significant shift from traditional methods, which often blame individuals for errors without looking at whether the system supported them. The researchers demonstrated that their tool could distinguish between different types of risks, such as separating issues with the physical environment from issues with team dynamics. This precision allows hospital managers to move beyond generic solutions. If the tool reveals that the problem lies in the environment, managers know to focus on reducing distractions or improving the safety culture, rather than buying more equipment or retraining staff.

While the tool proved effective within the study, the researchers noted that it was tested primarily among nurses in large, tertiary hospitals in China. This means the results might look different in smaller clinics or in countries with different regulations. The study also relied on nurses reporting their own experiences, which can sometimes be influenced by how they wish to be perceived, though the researchers took steps to ensure anonymity. Furthermore, because the study looked at a single point in time, it could not prove that using the scale directly prevents future errors, though the strong design suggests it is a powerful step in that direction. The authors suggest that future work should test the scale in different settings and track whether improvements in the scores lead to fewer actual medication mistakes over time.

Ultimately, this research provides a systematic way to diagnose the health of a hospital's medication safety system. By treating safety as a series of interactions rather than a list of rules, the new scale offers a way to spot vulnerabilities before they lead to an incident. It empowers nurse managers to see exactly where the system is fraying, whether it is a gap in training, a flaw in the workflow, or a breakdown in communication. This shift from reactive checking to proactive assessment represents a practical step toward a culture where safety is built into the very fabric of daily operations, ensuring that the complex machinery of anesthesia care functions smoothly for every patient.