Measuring what’s important: client transformation

Research Results ESAF India

Lea en español *** Lisez en français

Published on the Center for Financial Inclusion’s blog April 15th.

Measuring Transformation

>> Posted by Bobbi Gray, Research Director, Freedom from Hunger

While recent research indicates that access to and use of microcredit alone is not transformative for the average client served (see “Where Credit Is Due“), there has been very little discussion about the types of indicators being used to measure “transformation” in the ongoing debates. In fact, it seems that we all have accepted the general findings that microcredit has only had modest impacts on, along with other indicators of poverty and well-being, education, health, and social capital because the randomized controlled trials (RCTs) have said so. There needs to be greater thought and debate about the choices of indicators used to support these conclusions.

Freedom from Hunger over the past 20-plus years has integrated health with microfinance and helped build a body of knowledge indicating that microfinance plus health services can enhance health outcomes. In an ongoing partnership with the Microcredit Summit Campaign, supported by Johnson & Johnson, we have pilot-tested a series of health indicators that financial service providers (FSPs) can use to track client health outcomes. This pilot test was built on years of experience of evaluating health outcomes with our FSP partners, as well as on similar experiences of developing common tracking indicators in the health sector. We created a list of criteria to assess the types of indicators we felt would be meaningful to track—for individuals with and without health services – which included dimensions of feasibility, usability, and reliability. Initial results have been shared in several webinars with SEEP and the Social Performance Task Force.

It’s important to note that this pilot test effort was not about “proving” impact, but rather developing common techniques for monitoring client outcomes that FSPs could use over time. However, this experience has shown how difficult it is to identify indicators that best measure certain health outcomes. What initially might appear as an intuitive indicator to use — for example, how often a person reports being ill or seeking medical treatment — is found to be more difficult than expected. Morbidity — or reports of illness — is not an easy measure for health sector actors or those who directly work to improve health outcomes because it is influenced by the seasons, by specific efforts, and other factors, so care has to be taken when interpreting results. Reports of seeking medical treatment are complicated by whether people are satisfied with the services they can seek and may not always reflect financial capability but preferences or lack of available health services.

Read the rest of the article

Relevant resources