Terms of Reference: External Evaluation of the Integrated programme for the urban poor living in slums and settlement
 GOAL India
 Location: Kolkata and Mahestala Municipalities
 Last Date: October 25, 2010
 Email: goal@goalindia.org (Reference: DevNetJobsIndia.org)

Terms of Reference: External Evaluation of the Integrated programme for the urban poor living in slums and settlements by GOAL India.

External Evaluation Terms of Reference, October 2010 

 GOAL is an international humanitarian organization dedicated to alleviating the suffering the poorest of the poor. GOAL in India supports the overall mission of the organization by implementing poverty alleviation programmes in West Bengal , through partnerships with national NGOs with the objective of building the capacities of the poorest of the poor towards self sustenance and self determination, while simultaneously reducing their vulnerability to crises, neglect, abuse and exploitation. GOAL India is committed to eradication of poverty in all forms: social, economic, cultural, political etc and has strategized investment in area based integrated programmes to address the multiple needs of individuals, households and communities in underdeveloped urban and rural areas of West Bengal.   

Under the framework of the Country Strategic Plan (2007-2011) ,  GOAL India has been implementing the Integrated Programme for the urban poor living in slums and settlements, through two separate projects one for six settlements in the Kolkata and Mahestala Municipalities and the other with two settlements in the Howrah Municipality,  West Bengal.  Refer Annexure I for project summary. 

The Country Strategic Plan (2007-2011), makes a commitment to an evaluation which will focus on “the poverty impacts of the CSP 2007-2011” . To maximise the utility of such an evaluation, this evaluation needs to be carried out before the end of the current plan / programme period  2007-2011.  

The Primary audience for the evaluation will be the GOAL India Management team, while the secondary audience will include the GOAL India national partner organizations, GOAL HQ and Irish Aid, other audiences will include local stakeholders. 

The purpose of this evaluation is to provide GOAL India with an independent, evidence –based assessment of how the programme strategies adopted by GOAL India for the Integrated Programme for the urban poor living in slums and settlements has contributed to reducing the poverty and vulnerability of targeted communities . The assessment will help inform the development of  a performance based GOAL India support strategy for the development of poverty alleviation programme in India beyond 2011 and contribute to how GOAL India partners might strengthen their programming.

The evaluation will focus on the contribution that the Integrated Programme for the urban poor living in slums and settlements has made to poverty reduction and what the stakeholders ( partners and communities) have achieved with the support provided by GOAL India. The overarching question for the evaluation will thus be : 

“To what extent have the projects under the Integrated Programme for the urban poor in slums and settlements contributed to reducing poverty and vulnerability”?

In respect to this question, the evaluation will provide an assessment based upon outcomes and achievements of the Integrated programme. The assessment will examine in detail qualitative and quantitative evidence from a substantive and representative sample of the settlements in Kolkata, Mahestala and Howrah Municipalities. In assessing performance, the evaluators will take cognisance of the theory of change, results’ framework and strategy for poverty reduction as stated in the GOAL India CSP 2007-2011. 

GOAL India recommends that the evaluation will use the OCED-DAC evaluation criteria of relevance, effectiveness, efficiency and sustainability[1]. As appropriate , assessments against these criteria will be backed by evidence of outcomes at the immediate and/or intermediate objective levels. Assessments will refer to the annual proposals of the two projects under the Integrated Programme for the urban poor living in slums and settlements, West Bengal.    

Key questions for consideration include: 

Relevance 

1. To what extent are the projects under the Integrated Programme for the urban poor living in slums and settlements a relevant response to the multi-dimensional  aspects of poverty and vulnerability ?. 

Effectiveness:

2. To what extent have the projects under the Integrated Programme for the urban poor living in slums and settlements been effective ( immediate and intermediate outcome levels) in helping reduce poverty and vulnerability through supporting responses to crises, strengthening the development of communities  and improving access to resources and services? 

3. To what extent have the projects under the  Integrated Programme for the urban poor living in slums and settlements, informed by situational analysis and policies , focus on the achievement of results, accountability and the measurement of longer term impacts? 

Efficiency: 

4. To what extent have the projects in the Integrated Programme for the urban poor living in slums and settlements,  involved the targeted communities  and local stakeholders at the ward,  and municipal level thereby helping strengthen programme participation and ownership in the delivery of poverty and vulnerability focussed programme?. 

5. What factors have enabled the projects under the Integrated Programme for the urban poor living in slums and settlements,  to deliver efficiently on the strategic objectives as elaborated in the project proposals ?. 

6. To what extent have the projects under the Integrated Programme for the urban poor living in slums and settlements been efficiently managed by GOAL India and its partners?  

Sustainability: 

7. Is there any evidence that the benefits resulting from the GOAL India funding support are likely to be sustained? 

This document will not clarify exhaustively the methodology to be undertaken by a consultant(s) in carrying out this evaluation; it will be the responsibility of each interested consultant to identify how s/he/they would propose to undertake the assignment and bench mark it against internationally recognised best practice.  

The following are to be borne in mind however: 

§  The overall objective of the evaluation framework is to examine the extent to which the Integrated Programme for the urban poor living in slums and settlements has been able to promote improvements specifically related to coverage of interventions and quality of outcome[2].  Adhering to the logic model/ results based management approach , the results of the assessment shall not only be used to flag what the initiative has achieved but also shall provide diagnostic insights into the processes and comment on the efficiencies. 

§  In consonance with the implementation design, a cross sectional evaluation design is proposed.

§  wherein both quantitative and qualitative components are used to assess the results and outcomes. 

§  The Mix design will be followed for the quantitative component and quantitative findings will be substantiated with the qualitative findings to assess the overall impacts. Also, to make the design more robust it is proposed to have the comparison group ( if feasible)  during the assessment so that the impact can be attributed to the project.  

§  The key objective of the assessment  will be to measure and compare changes in key project indicators. To measure changes, which could have occurred due to project interventions, sample size should be statistically adequate to identify and measure those changes.  

§  To make the evaluation effective, the  output should necessarily present a synthesis of the “What (& why) is happening”, “What (& why) had happened” and “What (& why) can happen” i.e. Present, Past and Future.   

§  There is significant prior documentation pertaining to the programme, in the form of proposals, monitoring reports etc. All of this documentation will be made available to the consultants for reference. 

§  Fieldwork will be required to facilitate the consultant(s) to arrive at a conclusion pertaining to each of the matters outline above. Staff members of GOAL India and of Partner organizations will be readily available to offer views and ensure efficient implementation of the evaluation fieldwork. 

§  The assessment will employ participatory tools and skills to facilitate discussions. 

 The outputs of this evaluation process will be; 

1)     A detailed report that outlines progress made in relation to set objectives, including the findings, analysis, key lessons and recommendations. The report will also outline key challenges and emerging opportunities for GOAL India and the respective GOAL India partners. The findings will be supported by quantitative and qualitative evidence  related to outcomes.

2)     Provide specific recommendations on the future direction of the Integrated Programme for the urban poor living in slums and settlements,  with specific reference to the latest best practice.

3)     Recommendation of appropriate methodologies and indicators for measuring the impact of the Integrated Programme for the urban poor living in slums and settlements, as well as a review of current methodologies and indicators. 

The report will be expected to include clear justifications for the choices and recommendations proposed. These should include short term and long term recommendations. 

The consultant(s) will be expected to formally present a draft report to GOAL India within two weeks of concluding the evaluation fieldwork.  The presentation should highlight major findings and observations and core recommendations.  The formal presentation will afford GOAL India, the opportunity to comment on the evaluation findings and suggest final amendments. 

Subsequently, a final report will be expected from the consultant(s) within one week of the presentation/ receipt of feedback from GOAL India on the draft report. 

 It is envisaged that the entire process, including fieldwork, documentation and presentation of evaluation findings will be completed in not longer than 40 days. 

The evaluation is planned to commence on the 1^st week of November, 2010 and a report submitted by 10^th of   December, 2010.   

 All interested consultants are requested to submit a document tendering for this assignment.  Each tender should provide detail on the following: 

§  The consultant’s understanding of the TOR

§  Proposed methodology to be adopted in achieving TOR

§  Time frame for completion of task

§  Proposed team for the assignment with their CVs.

§  Non-financial resources required (e.g. transport, personnel time, administrative arrangements, etc.)

§  Preferred payment schedule.

§  Two references (One of your own choice and the other from your last client/employer).

§  Proposed budget; including an overall quotation in Indian Rupees for all the services to be provided and must itemize the following:

§  An all inclusive day rate for (professional and administrative)

§  An amount for per diems (daily subsistence allowance) if applicable.

§  Any other cost indicating the nature of such costs.

§  Summary of the total costs for the services proposed. 

Please note that , costs for proposal preparation and of negotiating a contract, including travel cannot be reimbursed as a direct cost of the assignment. 

The detailed proposal will be sent to GOAL India by the 25^th of October,2010 either through e-mail  at goal@goalindia.org with subject line marked as “ GI Integrated Programme for the urban poor living in slums and settlements,   –Evaluation 2010 – Proposal” or through post , addressed to “The Administrator” , GOAL India , 39- Hindustan Park, Kolkata -700029. Please inscribe on the outside of the envelope in bold “GI Integrated Programme for the urban poor living in slums and settlements, –Evaluation 2010 – Proposal” 

The  proposal will be evaluated based on the following criteria 

§  Known reliability in delivery of timely and quality services

§  Suitability of experience, field specific and thematic

§  Suitability of qualifications

§  Demonstrated understanding of the evaluation proposed

§  Cost. 

Annexure I 

Summary of the projects under the Integrated Programme for the urban poor living in slums and settlements. 

Integrated programme for the Urban Poor in Kolkata & Mahestala Municipalities 2007-2011). – The area based integrated programme is being  implemented for the approximately 2,200 households in six settlements of Kolkata and Mahestala Municipalities. RIGHT TRACK  is   GOAL India’s implementing partner for the programme. The programme prioritizes the Health, Education & Livelihoods needs of the target population.  

Integrated programme for the Urban Poor in Howrah Municipality( 2009-2011). – The three year area based integrated programme is being  implemented for the approximately 325 households in two settlements of Tikiapara , Howrah Municipality. KODALIPARA DEVELOPMENT SOCIETY    ( KDS ) is   GOAL India’s implementing partner for the programme. The programme prioritizes the Health, Education & Livelihoods needs of the target population.   

Annexure II 

OUTCOMES TO BE MEASURED AT THE END OF 2011.