Header

Learning and outcome evaluation of textbooks provision to children (ETF programme)

Zimbabwe - Harare

Background of the Evaluation

Learners have been provided with textbooks to reduce the pupil: textbook ratio from 15:1 to 1:1 with the intended outcome of improving learning achievement. School Development Committees (SDCs) have been trained in school governance and financial management in order to improve the relationship between service providers and service users. SDCs have also been trained to understand the relationship between school levies as part of the operational cost for the school and the provision of the textbooks. The work has been undertaken under a programme of revitalising the education system in Zimbabwe with funds from the Education Transition Fund (ETF).

It is anticipated that some change will be recorded in learners’ achievement with the reduction of the pupil: textbook ratio. To record this difference, a study before the use of the textbook and after the use has been planned. The study is also expected to look into the outcomes of the implementation of the programme as outlined in the ETF project proposal.

Goal and objectives of the evaluation

This evaluation aims to provide to Government, Donors, Local Authorities, Civil Society and Communities, accurate evidence on the effective impact of the ETF programme on education system and children learning outcomes and lessons learned of strengths and weakness that will be used for the consolidation of the programme and the development of the mid-term strategic plan of education.

The objectives of the evaluation are to:

1.Measure the short term effectiveness of the provision of text books on the performance and quality of the education through the evidence of improvement of indicators of drop-out rate, pass rate at grade 7, etc.
2.Measure the appropriateness and effectiveness of the provision of teaching and learning materials on children’s learning
3.Measure the effective contribution of the programme to the revitalization of the education system and capacity of management;
4.Assess the impact of the programme on communities and parents contributions to children learning (what change?);
5.Build national capacity of leading on impact evaluation and to conduct learning assessments at a national scale.

Objectives of the assignment: Working closely with MOESAC

Implement a national survey of learners in selected grades to measure their achievements in learning the core curriculum subjects of Mathematics, Shona/Ndebele, English and Environmental Sciences.

- Collect background information (for pupils, teachers and schools) with some extra questions added where information collected at school is not adequate.
- Allow for comparisons (at provincial, regional and national levels) to be made, with results collected at the beginning of the academic year before the use of textbooks and at the end of the academic year after use of textbooks so that the initial impact of the textbooks can be measured in terms of learning outcomes.
- Build the capacity of MoESAC and the Zimbabwe Schools Examinations Council (ZIMSEC) institutions to design, implement and analyse results of student achievement surveys that meet international norms of objectivity and independence.

Scope of the assignment:

1.Provide technical input and expert advice into the creation of a detailed survey implementation master plan which incorporates all necessary methodological, capacity building, financial, procurement and logistical aspects, so that the survey main data collection can be conducted in February 2011 and then again at the end of the school year in October 2011.
2.Design test instruments for learners, teachers and SDC members in schools with teachers and students involved in the survey then, revise and finalise the test instruments for utilising in the survey at the beginning and end of the 2011 academic year.
3.Provide local consultants with guidelines on principles and methods of designing learning assessments in which there is clear information of the number of questions, skill levels and criteria for each skill.
4.Support the MoESAC (ZIMSEC) survey co-ordinators, donor stakeholders, domestic consultants and all education staff involved in the survey to implement the necessary task and activities agreed in the survey master plan. For tasks which are highly technical and complex it will be necessary for the consultants to take a direct lead in drafting material and undertaking statistical analysis. For less demanding work the consultants will be expected to guide and mentor national counterparts and provide technical backstopping to ensure good quality work is delivered on a timely basis.
5.In addition to assisting in the activities described above, the consultants will be required to draft comprehensive reports that detail the progress of the survey during the implementation phase and present the survey findings in a detailed, high quality and comprehensive manner. The survey findings, methodology and data must meet international academic standards and be able to withstand independent, objective scrutiny

Outcomes of the assignment:

1.A well organised and nationally representative survey of primary learner achievement is implemented between February and December 2011, with the majority of results and findings synthesised into a draft final survey report by February 2012.

2.The following documents produced:

a)Reports on principles, methods, and experiences in conducting surveys for assessing learning outcomes of primary students in some developed, regional countries and countries with similar GDP.
b)Principles and methods of designing tests of core for selected grades learners, their teachers and school principals.
c)Procedures for introducing guidelines for surveying, marking, collecting data in primary schools, districts, provinces and nationally.

3.Enhanced national capacity at all levels to implement future learner achievement studies.

4.An increased recognition at the central level amongst senior government education officials of the value and importance of implementing a regular programme of learner achievement testing to inform policy debate and influence education development strategies and investment targeting.

5.Effect of text books report and recommendations to the donors and education stakeholders about ETF intervention.

6.Presentation to stakeholder meeting.

Requirements for consultant inputs

It is anticipated that a total of 12 person months will be required to complete this assignment, using a team of international and local consultants in the following positions:

1.Team Leader and Learner Achievement Specialist
2.Statistical Sampling and Analysis Specialist
3.Test Item and Test Design Specialist

Within the 12 person months, if required short term staff /consultants will be hired or contracted for specific technical work.

Required Expertise, Qualifications and Experience:

The following skills are all essential and should be held by at least one of the individuals nominated by the consultant.

- Extensive capacity and experiences in designing, managing and implementing large student achievement studies in a developing country.
- Strong technical skills and experience in the survey activities
- Good knowledge of primary education in developing African countries, preferably in Zimbabwe and detailed understanding of primary education reforms and current assessment techniques used in Zimbabwe will be an asset.
- Extensive knowledge and experience of international standards and assessment techniques for Mathematics and literacy at primary level.
- Expertise in test and questionnaire development, probability sampling and statistical analysis.
- Strong communication skills, both oral and written, to present complex material in an easily understandable way.
- Ability to work flexibly in sometimes challenging situations and establish good working cooperation with national consultants and government partners.

Reporting Requirements
In addition to the consultants to be hired through this package, additional support will be provided through the following:

- Short term call down international expert for design, oversight and monitoring of survey progress
- National consultant (institution or company) for implementation of 2011 survey
How to apply
3. Submission Requirements

If you have experience of working in a similar capacity, meet the above profile and want to make an active and lasting contribution to build a better world for children, send your application to the following address.

HR Specialist
(Consultancy Notice No. 2)
UNICEF, 6 Fairbridge Avenue,
P O Box 1250
Belgravia, Harare

Or email: hararevacancies@gmail.com

Applications should be received by 14 February 2011. Only candidates who are under serious consideration will be contacted.