Implementation Fidelity and Quality of the Community Health Information System at Primary Health Care Level in Rural Ethiopia: A Historical Process Evaluation of the 2016 CHIS Implementation

In the vast, rolling landscapes of rural Ethiopia, the health of a community often depends on a single, quiet fact: does the person in charge know exactly who lives there? For decades, health systems in low-resource settings have struggled with a fundamental disconnect. While clinics could count the medicines they dispensed or the vaccines they gave, they often lacked a reliable, up-to-date map of the families they served. Without knowing the precise number of households, the ages of children, or the status of sanitation in a village, planners were forced to guess. This gap meant that resources could be misdirected, and vulnerable families could be overlooked. To fix this, the Ethiopian government introduced a system called the Community Health Information System. It is a method of keeping a detailed, paper-based record for every single family in a community, managed by local health workers. The goal was simple but ambitious: to turn scattered, informal notes into a unified, accurate picture of community health, allowing leaders to make decisions based on real facts rather than estimates.

In 2016, researchers set out to see if this new system was actually working as intended in the rural highlands of the Tigray region. They did not just ask the health workers if they were using the system; they went into the villages to check the records against reality. The study focused on seventeen small health posts spread across four rural districts. The team, led by researchers from Mekelle University and the Tigray Regional Health Bureau, examined thousands of family folders—thick, organized files containing the demographic and health history of each household. They cross-referenced these files with the actual people living in the homes, checking if the names, numbers, and health details matched. They also looked at whether the health workers had the necessary tools, like ink, brushes, and filing cabinets, and whether they were following the official rules for updating the records.

The results revealed a system that was remarkably well-built but still struggling to stay current. The researchers found that the physical foundation of the system was strong. In nearly every health post they visited, the essential tools were present. The family folders, the filing shelves, and the master indexes that help locate specific families were available in almost all locations. When it came to the sheer number of families registered, the system was highly effective. Out of an estimated 25,639 households in the area, the health workers had successfully created a file for 24,569 of them. This meant that more than 95 percent of the community was officially on the books, a massive achievement for a system in its early stages of rollout. The health workers were also following the standard procedures for organizing these files, sorting them by household number and keeping them in order, which showed a high level of adherence to the national guidelines.

However, the study uncovered a significant gap between having the system and keeping it fresh. While the folders existed and were mostly complete, the information inside them was not always up to date. When the researchers compared the written records with what they observed in the households, they found inconsistencies. For example, the records often failed to reflect recent changes, such as a new baby born, a family member moving away, or a change in the status of a latrine or handwashing facility. The data regarding sanitation was particularly unreliable; the written records agreed with the actual conditions in the home less than two-thirds of the time for handwashing facilities. This suggests that while the health workers were good at starting the files, the daily habit of updating them with new, dynamic information was slipping. The system was capturing the static facts of who lived where, but it was losing the fluid reality of what was happening in those homes.

The overall picture that emerged was one of a system that had successfully established its presence but had not yet mastered the rhythm of maintenance. The researchers calculated a composite score for the system's performance, weighing the availability of tools, the completeness of the registration, and the accuracy of the data. The final score indicated a "very good" level of implementation, driven largely by the high number of registered families and the availability of materials. Yet, the lower scores for data consistency served as a clear warning. The study concluded that the system was not failing because of a lack of resources or a failure to start; it was failing because of the difficulty of keeping the records current in a busy, resource-constrained environment. The researchers noted that the presence of the tools did not guarantee the quality of the information.

This evaluation provided a crucial snapshot of the system at a specific moment in time, showing that the structural work was done but the operational work remained unfinished. The findings suggest that for the system to truly support health decisions, the focus must shift from simply distributing folders to ensuring they are constantly updated. The researchers recommended that future efforts should prioritize regular training and supportive supervision to help health workers maintain the accuracy of their records. Without this ongoing attention to the details of daily updates, the system risks becoming a static archive of the past rather than a living tool for the future. The study stands as a historical record of a system that had taken its first, strong steps, proving that the foundation was solid, even if the roof still needed some repair.