The Role of Digital Monitoring and Evaluation (M&E) Practices in Enhancing Organizational Performance: Evidence from Rutongo Hospital, Rwanda
This study of Rutongo Hospital in Rwanda reveals that digital monitoring and evaluation practices do not uniformly boost organizational performance but instead drive specific outcomes like cost efficiency and productivity through distinct mechanisms, contingent upon strong local infrastructure, digital literacy, and evidence-based planning rather than donor dependency.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of the paper below. It is not written or endorsed by the authors. For technical accuracy, refer to the original paper. Read full disclaimer
In many hospitals around the world, keeping track of how well services are running often relies on paper forms, manual calculations, and reports that arrive long after the events they describe. This lag makes it difficult for managers to spot problems quickly or to use information to make better decisions. To solve this, health systems are increasingly turning to digital monitoring and evaluation. This approach uses computers, tablets, and software to collect, store, and analyze data in real time. The hope is that by making information available instantly and accurately, hospital staff can work more efficiently, patients can receive better care, and resources can be used more wisely. However, simply buying new technology does not guarantee success. The real question is whether these digital tools actually improve how a hospital performs, or if they just add a layer of complexity without changing the outcome.
Researchers at the University of Lay Adventists of Kigali set out to answer this question by looking closely at Rutongo Hospital, a district facility in Rwanda. They surveyed 160 staff members, ranging from doctors and nurses to administrators and data officers, to understand how digital tools were being used and what effect those tools had on the hospital's daily operations. The team examined specific practices, such as using mobile apps to record patient data, storing information in a central digital database, and using automated software to analyze trends. They then measured how these practices influenced four key areas of performance: how satisfied patients were with their care, how efficiently the hospital used its resources, how well the staff worked together, and how effectively the hospital managed its costs.
The study revealed that the relationship between digital tools and hospital performance is not a simple story of "more technology equals better results." Instead, the impact depends entirely on which specific tool is used and which part of the hospital's performance is being measured. For instance, the researchers found that having a centralized digital database was the single most powerful factor for improving cost efficiency. When all the hospital's data was stored in one secure, well-managed system, the facility became significantly better at controlling its spending. Similarly, the combination of automated data analysis tools and ongoing technical training for staff was the primary driver of increased staff productivity. When staff had software that could crunch numbers for them and the skills to use it, they were able to get more work done.
However, the study also uncovered some surprising downsides to the early stages of digital adoption. The mere presence of digital tools, such as tablets and mobile apps, was actually associated with a slight drop in patient satisfaction and a less efficient use of resources. This suggests that when a hospital first introduces new technology, it can create friction. Staff members might spend more time looking at screens than interacting with patients, or they might struggle with new workflows, leading to temporary delays. The data indicated that these tools only became beneficial once they were paired with specific supporting actions. For example, patient satisfaction improved significantly only when the hospital established a system for providing timely feedback and taking action based on the data. It was not the data collection itself that pleased patients, but the speed with which the hospital responded to the information.
The researchers also discovered that the success of these digital systems depended heavily on the environment in which they operated. The benefits of digital monitoring were strongest when the hospital had reliable infrastructure, such as stable electricity and internet connections, and when the staff possessed strong digital skills. A critical finding was that hospitals relying heavily on external donor support for their monitoring systems tended to be less cost-efficient. In contrast, hospitals that invested in building their own local expertise and skills saw better financial results. This suggests that while outside funding can help start a project, long-term efficiency comes from developing internal capacity rather than depending on external administrators.
To understand the full picture, the researchers used a statistical method to group the many different aspects of the hospital's operations into distinct categories. They found that digital infrastructure, data quality, human skills, and patient outcomes are separate dimensions that do not automatically improve together. A hospital can have excellent technology and secure data, but if the staff lacks the training to use that data for planning, the technology will not lead to better patient care. The study concluded that digital monitoring and evaluation is not a magic switch that fixes everything at once. It is a set of specific practices that, when matched with the right training, infrastructure, and local leadership, can drive specific improvements. For Rutongo Hospital, and others like it, the path forward involves moving beyond simply installing software and focusing instead on building the human and organizational systems needed to make that software work.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.