How should we define the success of a health project?

In the field of health ODA, we clearly experience the shifting perceptions and behaviors of residents and the changing atmosphere of a village.

However, you may have felt frustrated when the final report only permits "dry numbers" such as a "90% vaccination rate" or "one health center constructed.

" This is because the actual changes in the lives of residents hidden behind figures in a complex social context are difficult to fully capture through conventional indicator systems alone.

To fill this "void in capturing performance" and lead qualitative innovation in projects, it is worth paying attention to the "Most Significant Change (MSC)" technique as a strategic tool.

1. Monitoring Beyond Indicators: Proving Performance through Stories

MSC is a participatory monitoring and evaluation (M&E) technique that moves away from traditional quantitative-centered evaluation to collect and analyze changes directly experienced and witnessed by stakeholders in the form of "stories.

The methodology is simple yet powerful. It begins by asking field practitioners and beneficiaries,

"What is the most significant change that has occurred over the past period?"

This process goes beyond deductive verification of figures and allows for an inductive understanding of what valuable changes have actually taken place on the ground.

2. Why is MSC Necessary for Health ODA Projects?

In health projects where social behavioral change and governance strengthening are key, MSC provides the following strategic values.

• Capturing Unexpected Outcomes. It can sensitively identify positive or negative changes unforeseen during the design stage, such as the spontaneous organization of health committees or local self-help activities.

• Understanding Social Context. Like the gender profiling cases in the Philippines, it can prove shifts in cultural perceptions or household power structures affecting health service accessibility through "thick description."

• Reflecting the Voices of the Vulnerable. It directly conveys the voices of groups like women and the impoverished—who are often obscured in indicator-driven evaluations—to verify the realization of health equity.

3. Organizational Learning through ‘Feedback’ Beyond Simple Promotion

While MSC is often used for promotional purposes, such as creating "Best Practice" collections, its true essence lies in the "selection process." The process of stakeholders and field practitioners discussing and agreeing on which change is "most significant" naturally reveals the values the organization pursues and the priorities of the project.

The feedback process sharing the meaning of these derived changes back with the field and the organization goes beyond merely reporting results.

It promotes organizational learning and serves as an important foundation for aligning future directions and execution strategies.

Ultimately, this leads to a practical driving force for improving the design and implementation of subsequent project phases.

A New Performance Management Paradigm Where Data Meets Stories

Quantitative statistics show the scale of a health project, but the stories provided by MSC prove the "meaning" and "sustainability" of that project.

When qualitative insights based on MSC are added to precise data analysis, we can provide the best solutions that solve complex local problems and lead to substantial improvements in the quality of life for residents.

*References

1. Dart, J. J., & Davies, R. J. (2003). A Dialogical, Story-Based Evaluation Tool: The Most Significant Change Technique. American Journal of Evaluation, 24(2), 137-155.

2. Davies, R., & Dart, J. (2005). The ‘Most Significant Change’ (MSC) Technique: A Guide to Its Use. (Version 1.0).

3. INTRAC. (2017). MOST SIGNIFICANT CHANGE. (M&E Universe Series).

4. Mwangi, P. W., Syengo, G. M., & Abuya, I. O. (2023). Contributions of the Most Significant Change (MSC) to Monitoring and Evaluation. African Journal of Monitoring and Evaluation, 1, 13-21.

5. Sharma, M. K., Khanal, S. P., & van Teijlingen, E. (2024). Most Significant Change Approach: A Guide to Assess the Programmatic Effects. International Journal of Qualitative Methods, 23, 1-10.