Saturday, 25 May 2013

SELECTING PROJECT INDICATORS

In M&E planning, one of the things that managers have to work out are a set of indicators that will be used to measure outputs against program goals. Understandably, questions often arise regarding what indicators are, their importance and what to consider when choosing them. Here, we will take a look at examples of indicators, their types, their importance and eventually, how to select appropriate indicators.


What is an indicator?


An indicator is a variable that is normally used as a benchmark for measuring program or project outputs. It is “that thing” that shows that an undertaking has had the desired impact. It is on the basis of indicators that evidence can be built on the impact of any undertaking. Most often, indicators are quantitative in nature, however, in some few cases, they are qualitative.


Most often indicators are confused with other project elements such as objectives or targets. Indeed, understandably so. Unlike targets or results which specify the level of achievement, indicators do not. For example, in a project on access to safe water, statements such as “an increase in the proportion of households reporting the consistent use of chlorinated drinking water” or “70% of households reporting the consistent use of chlorinated drinking water” are not indicators. Rather, an indicator could be “The proportion of households reporting the consistent use of chlorinated drinking water.”


Importance of Indicators


Indicators are an important for any project, particularly for monitoring and evaluation purposes. Some of the benefits of indicators are highlighted below.




  1. At the initial phase of a project, indicators are important for the purposes of defining how the intervention will be measured. Through the indicators, managers are able to pre-determine how effectiveness will be evaluated in a precise and clear manner.

  2. During project implementation, indicators serve the purpose of aiding program managers assess project progress and highlight areas for possible improvement. In this case, when the indicators are measured against project goals, managers can be able to measure progress towards goals and inform the need for corrective measures against potential catastrophes.

  3. At the evaluation phase, indicators provide the basis for which the evaluators will assess the project impact. Without the indicators, evaluation becomes an audacious responsibility.


Types of indicators


The three widely acknowledged types of indicators are process indicators, outcome indicators and impact indicators.


1. Process indicators: are those indicators that are used to measure project processes or activities. For example, in a Safe Water project, this could be “the number of chlorine dispensers installed at water points” or “the number of households that have received training on chlorination of water.”


2. Outcome Indicators: Are indicators that measure project outcomes. Outcomes are medium impacts of a project. For example, in the case of a Safe Water project, outcome indicators could be “the proportion of households using chlorinated drinking water” or “the percentage of children suffering from diarrhea.”


3. Impact Indicators: Are indicators that measure the long term impacts of a project, also known as the project impact. In the case of the Safe Water project, it could be, “the prevalence of under 5 mortality.”


Factors to consider when selecting project indicators


Any appropriate M&E indicator must meet particular thresholds. They must be:




  1. Precise/Well defined: Probably the most important characteristic of indicators is that they should be precise or well defined. I other words, indicators must not be ambiguous. Otherwise, different interpretations of indicators by different people implies different results for each

  2. Reliable: Reliability here implies that the indicator yields the same results on repeated trials/ attempts when used to measure outcomes. If an indicator doesn’t yield consistent results, then it is not a good indicator.

  3. Valid: Validity here implies that the indicator actually measures what it intends to measure. For example, if you intend to measure impact of a project on access to safe drinking water, it must measure exactly that and nothing else.

  4. Measurable: Needless to say that an indicator must be measurable. If an indicator cannot be measured, then it should and must not be used as an indicator.

  5. Practicable: In other cases, although an indicator can be measured, it is impracticable to do so due to the cost or process constraints. An indicator must be able to utilize locally available resources while at the same time being cost effective.


The following are some indicators for a climate change adaptation project in community level which focuses on farmers.

Process indicators

  1. No of farmers supplied with drought resistant crops

  2. No of community awareness meetings conducted

  3. No of wells/dams constructed

  4. No of farmers enrolled in crop insurance

  5. No. of irrigation systems constructed


Outcome indicators

  1. Proportion of food secure households

  2. Percentage of malnourished children under-5


Impact indicators

  1. Employment rates of the region

  2. prevalence of under 5 mortality

14 comments:

  1. […] Selecting Project Indicators (evaluateblog.wordpress.com) […]

    ReplyDelete
  2. […] ← SELECTING PROJECT INDICATORS May 28, 2013 · 6:22 am ↓ Jump to Comments […]

    ReplyDelete
  3. Replies
    1. a proxy indicator is an indirect indicator used to measure things that are otherwise not possible to measure. For example, it is qiute difficult to measure hunger levels, so a set of indicators that can help to determine the level is used (normally the Household Hunger Scale/ Index)

      Delete
  4. Thanks this is clearly explained.

    ~Blessings~

    ReplyDelete
  5. Frank, you are really good at helping people understand concepts. The fact that you used examples was so helpful to me.

    Thanks

    ReplyDelete
  6. Thanks John. Glad to be of help.

    ReplyDelete
  7. Dear Sir,

    Greeting of the day…………..

    We would like to introduce ourselves as Anant Learning and Development Pvt. Ltd. We are a team of professionals who are working on new innovations for inclusive growth of the communities in the country.

    We have been conducting field research in various states and have been interacting with a large number of stakeholders and it was observed that there is no tool/solution available for measuring the Impact or Impact Analysis of Skill Building programs and other Livelihoods programs being conducted by various Govt. agencies. Impact of such a program can only be analyzed if you receive validated data of students placed on regular intervals say up to four months or a year along with a proof of employment.
    We at Anant Learning and Development Pvt. Ltd. have devised a technology based application which will be clubbed with a vast network of trained team (Tracking Agents) who will physically track the placed students by your implementing agencies on a monthly/Quarterly/Annual basis. The data generated by the physical tracking will be sent directly to the client server with no manual intervention thus maintaining its sanctity. This will help in the following area:
    1. Gauging the Impact of the entire project.
    2. M&E of the entire project.
    3. Assessing the performance of Field Teams and generation of Post Placement and Impact Analysis reports .
    This process can be conducted for other projects too where beneficiary tracking is important and impact analysis of the entire project needs to be monitored/gauged.
    We would be more than happy to meet you and discuss this with you. We look forward to your response.

    With Regards

    Team Anant

    www.anantinnovation.com

    ReplyDelete
  8. Hi Frank,
    This is very simple for even the ordinary person who is not in M & E to understand. All the best

    ReplyDelete
  9. Hi Frank, thanks for this clear explanation. I have one question: how does the employment rate of the region relate to a climate change adaptation project?

    ReplyDelete
    Replies
    1. Climate change adaptation can influence employment rates in the long term. Building flood defenses like dams, for eaxmple, can create a source of water for irrigation meaning more people can practise agriculture. This may create jobs, both formal and informal hence improving employment rates. Even the actual process of building dams itself as a climate change adaptation technique is a souce of employment since it take months or even years to complete, with a l=high level of casual and forma labour required.

      Delete
  10. Hi Frank,
    Thanks a lot for this great piece of work, it is very informative; however I seem to have a different school of thought when it comes to process indicators. As you have stated in this article, they seem to me as output indicators; which are the immediate result after input e.g. when in treated mosquitoe net distribution output indicators here will be the number of households that have received mosquitoe nets, the number of clusters that have received mosquitoes nets (cluster here being either village, district etc). While process indicators are meant to identify indicators that can be used to improve intervention delivery most often it assesses the intervention fidelity ( was the intervention delivered as indented i.e. the quality of intervention delivery) or Process indicators measure ways in which program services and goods are provided (i.e., error rates). Often the indicators in process evaluation are very subjective and hence lots of qualitative work in this stage of evaluation.
    I am willing to engage more and share more if need be.

    ReplyDelete