Header

Nutrition Programme Consultancy

Final Evaluation
Terms of Reference for Consultant/Consulting Firm
Window of Opportunity Program in Sierra Leone



1. INTRODUCTION
CARE Country Office’s long-range mission statement is to address the root causes of poverty and suffering through capacity building, advocacy, and partnership so that vulnerable, disadvantaged, and marginalized people are empowered to participate effectively in achieving livelihood security, improved health status and realizing their right to live with dignity.

Background
Window of Opportunity, CARE’s flagship nutrition program, is implemented in five countries: Bangladesh, Indonesia, Nicaragua, Peru and Sierra Leone from 2008 through 2012. The overarching Window global goal is to protect, promote and support optimal infant and young child feeding and related maternal practices. To achieve this goal, Window has three objectives:
• Improve the enabling environment by catalyzing the formation of networks and providing an evidence base for policy decisions, Window builds a foundation for improved practices
• Strengthen the Health System to support IYCF and related maternal nutrition in order to create lasting change; Window builds the capacity of health system personnel at the local, district and national levels. A key component of this strategy is the creation of supervisory and referral systems that work with existing government infrastructures.
• Empower individuals and communities to make optimal IYCF and related maternal nutrition choices. Window’s activities are participatory and gender-sensitive, especially at the community level. Community members are invited to participate in the planning, implementation, delivery, and evaluation phases of the Window program, in order to foster ownership, sustainability, and empowerment.
In Sierra Leone, Window of Opportunity project is implemented in 12 chiefdoms in the districts of Koinadugu and Tonkolili. CARE Sierra Leone started the implementation of the Window of Opportunity project in January 2009 and will end in June 2012.

2. Evaluation Background:
Objective and evaluation questions
The overarching goal of the Final Evaluation is to assess the design, performance and effect of the Window of Opportunity Project as well as document lessons learned for future programming.
To accomplishing this general goal, the final evaluation has seven sub-objectives:
a. Assess the logic model of the project.
b. Assess the coherence between activities and objectives.
c. Assess activities implementation.
d. Identify barriers and enhancers to the implementation of activities.
e. Assess changes in IYCF practices.
f. Assess women’s empowerment, social capital and household food security issues as a part of the factors involve in the project context.
g. Assess changes in nutritional status among children 0-23 months of age
h. Identify and analyze lessons learned for future programming.

Methodology
The Final Evaluation includes four complementary dimensions and therefore, the methodology for the evaluation will be described in these terms as outlined below.

Design assessment
The logic framework and the detailed operation plan of the project have to be analyzed to understand the linkage between the Project logic model, activities implemented and the context and factors that explain IYCF practices in the intervention area.

Performance assessment
Performance of the Project will be assessed through a review of available documentation including quarterly and annual reports, the Midterm Review report as well as other internal reports made in the country office. Additionally, interviews and focus groups (among other qualitative methods) will be conducted to get more information and a better understanding of the barriers and enhancers in project implementation.
Effect assessment
Given that the baseline design did not include measurements of control population, Before-After method will be used to assess the effect of the Window of Opportunity Project. The following indicators, used also in baseline, must be included in effect assessment:

Table 2: Indicators of Final Evaluation of Window of Opportunity Program
Category Indicator
Nutritional Status Wasting, Underweight, Stunting
Infant and Young Child Feeding Practices
• Early initiation of breastfeeding
• Exclusive breastfeeding
• Timely complementary feeding
• Introduction of solid, semisolid and soft foods
• Minimum meal frequency
• Minimum dietary diversity
• Minimum acceptable diet
• Continued breastfeeding at one year
• Continued breastfeeding at two years
• Consumption of iron-rich or iron-fortified foods
• Bottle feeding

Program participants are compared to themselves before and after the intervention and function as both treatment and comparison group. http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTPOVERTY/EXTISPMA/0,,contentMDK:20188242~menuPK:415130~pagePK:148956~piPK:216618~theSitePK:384329,00.html


In line with the above mentioned, project effect has to be assessed using the same methods and characteristics applied for the baseline. Hence, the process of collecting and analyzing IYCF data it will be based on two documents; the first is the WHO recommendations established in the document titled Indicators for assessing infant and young child feeding practices, and the second is Infant and young child feeding practices. Collecting and Using Data: A step by step guide. For anthropometric data WHO/CDC reference population will be used as well as the standardized methods to calculate stunting, underweight and wasting. ,

Analysis of lessons learned for future programming
CARE is seeking to gain knowledge on lessons learned to feed into the programming process in other countries involved in the Window project as well as understand the sustainability and replicability of Project activities model. Hence, comprehensive analysis of the all information (quantitative and qualitative) gathered in final evaluation will be done to answer the questions establish to inform CARE’s organizational learning and knowledge sharing agenda.


7. TERMS OF THE CONSULTANCY
CARE Sierra Leon seeks to contract a firm to implement the Field Work for the final evaluation of Window of Opportunity program in Sierra Leone.

CARE USA consultant in collaboration with the CARE Sierra Leone Team will lead the final evaluation process. All activities will be coordinated with CARE Sierra Leone. The M&E Advisor from Window project CARE Sierra Leone will be in touch with the firm in order to coordinate the implementation of the Field Work.

In order to have a homogeneous and coherent evaluation in all five countries, a partner research institution is supporting the quality control of Project evaluation in all countries. As part of this quality control, this partner research institution has developed a global evaluation design that includes qualitative and quantitative tools; these tools will be used for the data collection.

The process of enumerator and supervisor training, pre-testing tools as well as the data collection will be supervised by CARE USA consultant in collaboration with CARE Sierra Leone team. All the administrative aspect concerning this contract will be addressed by the CARE Sierra Leone team

Methodology

In order to complete the field work, the methodology of the process will be divided as follows:

Quantitative Methods for Data Collection

a) Sample size: The number of households that will be interviewed will be a total of 1,000 ( one thousand), out of this, 250 must be mothers with children 0 up to 6 months and 750 mothers/ caregivers of children 6 up to 23 months.

b) Sampling strategy: Household Survey Randomized Cluster methodology will be used to select the houses that will be included in the sample. To do that, all the interventions communities have been organized in 30 clusters (see annex 1). At a minimum, 33 households will be interviewed within a cluster. Field data collection will be separated in to two categories, viz, anthropometric measurement and administration of a structured questionnaire as indicated in table 2 above.

c) Training of data collectors and supervisors will be the sole responsibility of the CARE USA consultant but organization (selection of trainees, venue for training, refreshment during training, supply of stationery) of the training will be the responsibility of the hired firm. Vehicle support for pretesting of questionnaire during training and field data collection will be the responsibility of CARE Sierra Leone.

d) CARE Sierra Leone will provide Salter scales and height boards that will be used by field data collectors for the anthropometric measurement.
e) Printing of the final questionnaire ( 1,000 of 10 pages per copy) to be used for field data collection will be the responsibility of the hired firm.
Qualitative Methods for Data Collection

f) Sampling strategy: The qualitative information will be collected at three different levels i.e National, district and community. CARE USA consultant will be responsible for the collection of information at the national level while the hired firm will be responsible for the collection of information at district and chiefdom levels. At community level, the intervention areas have been divided into three performing areas, high, medium and low performing. Each of the performing area has similar number of chiefdoms (see annex 2).
g) Sample size: The specific communities where focus group discussions will be held will be discussed with CARE USA consultant and CARE Sierra Leone Team. In each performing area, 3 focus group discussions and 4 key informant interviews (See annex 3) will be conducted. At the district level, information (3 key informant interviews each) will be collected at the district headquarter towns – Kabala and Magbruaka, See annex 3.
h) Training of qualitative enumerators will be the sole responsibility of the CARE USA consultant but organization (selection of trainees, venue for training, refreshment during training, supply of stationery) of the training will be the responsibility of the hired firm. Vehicle support for pretesting of discussion guides during training and field information collection will be the responsibility of CARE Sierra Leone.
i) Printing of the final focus group and key interview guides to be used for field information collection will be the responsibility of the hired firm.

The firm will be responsible for the following deliverables:
a. Print adequate finalized version of the questionnaire and discussion guides to complete data collection.
b. Conduct and record focus group and key informant interview. The scripts must be written in English before sending it to CARE Sierra Leone
c. Conduct the household survey according to the method described in the methodology section above.
d. Hiring of enumerators must be done at the district level to reduce conflict and maximize the use of local human resource.
e. Organize training for enumerators (qualitative and quantitative data) and supervisors. Enumerators and supervisors will be hired by the selected firm.
f. Develop the final sampling plan in coordination with CARE Sierra Leone and CARE USA consultant.
g. Develop strategies and mechanism to ensure data collection quality (qualitative and quantitative. Final strategy and mechanism to ensure data quality will be discussed with CARE Sierra Leone team and CARE USA consultant.
h. Conduct data entry, cleaning and send the data set to CARE Sierra Leone.
i. Write and submit field data collection operation report to CARE Sierra Leone.
Timeline
Activity Dates
1 Completion of sampling plan 3rd week April 2012
2 Enumerator and supervisors training and pre-testing Either 3rd or 4th week April 2012
3 Field data collection Between 4th week April to 3rd week May 2012
4 Data inputting and cleaning 1st week May to 4th week May 2012
5 Submission of field operation report to CARE SL Last week of May 2012


Payment schedule

Payment for service will be done in phases during the entire process.

? First payment: 40% will be paid to the firm on completing pre-testing of questionnaire and discussion guides.
? Second payment: 30% will be paid to the firm when the field data collection is completed and questionnaires and recorded scripts for the qualitative data is verified by CARE Sierra Leone team.
? Third payment: 30% will only be paid when all the deliverables mentioned above have been delivered to CARE Sierra Leone.

Manner of payment
Payment will depend on timely completion and submission of all documents required for the payment to be effected.

Bids will be open to the general public from the 27th March to 5th April 2012. An envelop containing the following:
? Most recent registration certificate
? History of similar services provided
? Technical proposal and budget
? 3 Referees with contact details

This information must reach the under mentioned addresses on or before 5th April 2012.
? The Administrator, CARE Office, 13 Bath Street, Freetown,
? The Administrative Assistant, CARE Office, Azzolini Highway, Makeni
? The Sub-Office Administrator, CARE Office, 7 Tarawally Drive, Yogomaya Kabala

http://www.who.int/nutrition/publications/infantfeeding/9789241596664/en/index.html
http://childhealthandnutrition.care2share.wikispaces.net/file/view/Infant%20and%20Young%20Child%20Feeding%20Practices%20-Collecting%20and%20Using%20Data-%20A%20Step-by-Step%20Guide.pdf
http://www.who.int/childgrowth/en/
http://www.who.int/childgrowth/software/en/


Annex 1.
District Chiefdom Section Name of community 0 to 5 6 to 23 Total Cluster
Koinadugu Sengbeh Koinadugu Kalkoya 13 33 46 2
Koinadugu 20 65 85 2
Yeraia Yeraia 15 114 129 2
Bilimaya Ismaia 6 76 82 3
Kamadugu Sengbehleroh 2 11 13 2
Dundukoh 9 50 59 2
Saiduya 4 29 33 2
Nafayie 6 19 25 3
Bendugu Kuranko Sansan 2 11 13 1
Yufunu 2 12 14 1
Kondeya 3 14 17 1
Nyafurandor 13 11 24 1
Foronoya 3 7 10 1
Heremakono Kompala 3 8 11 1
Sub totals 101 460 561

Koinadugu Wara Wara Yagala Yataya Igaia 6 24 30 3
Alusainya 2 16 18 3
Songaiabalia 3 9 12 3
Sokralla 3 21 24 3
Sarakoh 4 9 13 4
Makakura 6 14 20 3
Timbo Haffia 1 11 12 4
Timbo Sokralla 7 22 29 4
Heremakono Bendukura 2 26 28 5
Yagala Yataya 5 16 21 5
Konkoya 3 13 16 5
Kordala 1 5 6 5
Kasumpe 2 10 12 5
Kayakor Kamajimbor 8 21 29 5
Thonkoya 1 7 8 5
Sub totals 54 224 278

Koinadugu Folosaba Dembelia Musaia Musaia I 4 13 17 6
Musaia II 3 11 14 6
Hamadiya 5 10 15 6
Karimuya 4 15 19 6
Musaia Junction 5 7 12 4
Dogoloya Dogoloya I 3 10 13 4
Dogoloya II 4 10 14 4
Dogoloya III 5 7 12 4
Mamudia Mamudia 6 10 16 6
Balandugu Koromasilaya 15 55 70 4
Gbentu Gbentu I 16 32 48 7
Gbentu II 17 33 50 7
Gbentu III 13 31 44 7
Gbentu Haffia 5 21 26 7
Hereko Hamdalai 3 5 8 6
Sub totals 108 270 378

Koinadugu Wara Wara Bafodia Bafodia Bafodia 1 24 235 259 8
Bafodia 11 18 227 245 8
Sakuta 16 51 67 8
Kakoya Kakoya 7 46 53 8
Kadanso Kakonso 2 38 40 8
Kadanso 18 81 99 8
Kamaninkie Kamaninkie 3 23 26 9
Kakondobie 5 59 64 9
Kapakie 8 77 85 9
Thelia Serekuday 5 59 64 9
Madiya 24 173 197 7
Thelia 15 95 110 7
Kaponpon Kaponpon 12 68 80 9
Kadanka 7 50 57 9
Sub totals 164 1282 1446

Koinadugu Dembelia Sinkunia Sinkunia Sinkunia 25 79 104 11
Bantaia 5 5 10 11
Masendeh 2 19 21 11
Numula Gbindi I 14 37 51 11
Gbindi II 8 53 61 10
Gbindi III 14 47 61 10
Gbindi IV 7 50 57 10
Gbindi V 9 56 65 10
Mawundia Dalabaya 1 28 29 10
Fulamansa 8 31 39 10
Sagalereh 3 20 23 10
Manah Yadia 3 26 29 11
Mannah I 9 62 71 11
Sogoria 7 19 26 6
Mannah II 5 51 56 11
Sub totals 90 499 589

Koinadugu Sulima Ganya Ganya 28 54 82 12
Sulaya 2 4 6 12
Bribaya 4 11 15 12
Samu 2 11 13 12
Timbako Limbaya 7 29 36 12
Banjuguya 2 8 10 13
Kaliyereh Kaliyereh 12 28 40 13
Gberia Fatombo Messendikuda 5 12 17 13
Kankaya 2 5 7 12
Falaba 32 80 112 12
Timbako GberiaTimbako 1 18 40 58 13
GberiaTimbako 11 11 27 38 13
Gberia Fatombo 19 45 64 13
Koindukura Koindukura 10 25 35 13
Sub totals 154 379 533

Koinadugu Kasonko Kankaykalyne Kamakainthay 5 42 47 14
Kagbasia I 7 51 58 14
Kagbasia II 9 42 51 14
Heremakono Katimbo 5 41 46 14
Kamakwie II 8 36 44 14
Gbonkobor Madina Gbonkorbor 7 58 65 15
Thankorosidia 12 45 57 15
Sawuria 6 58 64 15
Madingo Fadugu 30 267 297 14
Kamabinkie 6 35 41 14
Tongoya 5 48 53 15
Madina Gbonkorbor 7 64 71 15
Kamandie 4 52 56 15
Tamiso 11 Kasanikoro 15 60 75 15
Sub totals 126 899 1025

Koinadugu Diang Bendukoro Bendukoro 13 29 42 16
Isaia Isaia 7 24 31 16
Yarah Yarah 14 36 50 16
Gbenikoro Gbenikoro 10 47 57 16
Kania Kania 41 115 156 16
Kangbelfeh Foria 22 96 118 16
Nyawulia 23 76 99 17
Lengekoro Lengekoro 16 72 88 17
Madina Madina 14 34 48 17
Kondembaia Kondembaia 39 94 133 17
Sokralla Sokralla 1 14 49 63 17
Sokralla 2 12 26 38 17
Badala 16 43 59 17
Kamaron 16 27 43 18
Dondoya 10 19 29 18
Sub totals 267 787 1054

Koinadugu Neini Yiffin Yiffin 15 114 129 20
Saransiya 12 47 59 20
Telikoro 3 36 39 19
Soya 4 34 38 19
Yeben 6 51 57 19
Fankoya 10 49 59 19
Komontambaia 20 84 104 18
Neini Kondembaia 10 31 41 18
Kulayia 4 29 33 20
Upper Neini Firawa 19 124 143 20
Kalian Alkalia 123 700 823 18
Sesewulaia 14 35 49 18
Gbanbafera 5 13 18 19
Boikoro 9 26 35 19
Seradu Sumbaria 74 273 347 19
Sub totals 328 1646 1974


Tonkolili Gbonkolenkeh Lower Poli Maraka 11 14 25 21
Upper Masakor Warima 14 14 28 23
Petifu Mayawa Ropapa 8 14 22 22
Maboat 4 12 16 22
Bathpla 3 8 11 22
Rosarr 7 15 22 23
Makoya 6 15 21 23
Makenedy 5 11 16 22
Magberen 5 12 17 22
Royeama 1 3 11 14 22
Mafay 11 14 25 22
Yele Manowo Marukoh 10 9 19 23
Pintikili 8 15 23 23
Mamorka 7 16 23 23
Matopie 5 11 16 23
Mayorpor Mabankra 10 15 25 21
Maconteh 6 9 15 21
Mayamba Mabombor 11 28 39 21
Royeama 11 8 17 25 21
Petifu Mayorpor 29 45 74 21
Sub total 171 305 476

Tonkolili Tane Mangay Bana Mangay Bana 10 15 25 25
Rosengbeh 11 16 27 25
Mapaki Marborbor 4 9 13 24
Rosint 11 17 28 24
Matufulie 11 14 25 24
Matotoka Mabamp 7 14 21 24
Mawolie 4 12 16 24
Masarah Komeh 11 14 25 25
Mamankie 7 12 19 25
Mamanthly 12 14 26 25
Mafarah Potho 6 9 15 25
Matotoka 21 24 45 26
Maborbor Koray Madibie 6 11 17 27
Makrugbeh Robekeh 4 18 22 27
Matheleh Bana 10 15 25 26
Magbafth 8 16 24 26
Makrugbeh 8 14 22 26
Masankoro 4 8 12 26
Mathonkara Malaku 5 11 16 26
Mathonkara 14 19 33 27
Sub total 174 282 456

Tonkolili Kolifa Rowalla Makomp Mabia 8 16 24 27
Mabecthe 3 9 12 27
Malone 9 19 28 27
Maquee 7 12 19 28
Maberreh Nonkoh 3 15 18 28
Mayemberia 3 14 17 28
Mayossoh Mayossoh 9 25 34 28
Masoko Mayonie 5 14 19 28
Mamuntha Mamuntha 9 21 30 28
Magbass 5 23 28 29
Maborie 6 25 31 29
Lal- Lenken Rothatha 3 8 11 29
Rosinth 4 16 20 29
Magbereh Gbonkoh 5 15 20 29
Malongba 5 13 18 29
Madibie 3 9 12 30
Romangoro 7 17 24 30
Mayatha Makorie MB 2 9 11 30
Rogbereka 4 16 20 30
Masuba 3 9 12 30
Mabum 7 21 28 30
Sub total 110 326 436

Annex 2.

High Performing
1. Gbonkolenkeh
2. Neini
3. Wara Wara Bafodia
4. Sulima
Medium
1. Tane
2. Kholifa
3. Diang
4. Sengbe
Low
1. Kasonko
2. Folosaba Dembelia
3. Dembelia Sinkunia
4. Wara Wara Yagala

Annex 3.

Respondents for the qualitative methods

Levels Focus group Key Informant Interview
District
• District Nutritionist
• Local Council Health Committee point person
• District Medical Officer
Community • Mother to Mother group members
• Village Development Committee Members
• Community Based growth Promotion volunteers • Mother facilitator
• Chairman VDC
• One volunteer
• Peripheral Health Units staff

Job Email id: Care.SierraLeone(at)co.care.org