Objective
The Bill and Melinda Gates Foundation and its partners – Marie Stopes International (MSI),
Population Services International (PSI) and the International Planned Parenthood Federation (IPPF)
–introduced and integrated Cervical Cancer Screening and Preventive Therapy (CCS&PT) into
reproductive health services in four countries (Kenya, Nigeria, Tanzania, and Uganda).
BMFG contracted Khulisa to conduct 2 rounds of independent results verification reported by the
CCS&PT partners for 2 annual reporting periods. The overall purpose was to: (i) confirm the
partners’ annual reported results for the Foundation’s incentive payment decisions, whereby the
“best performing partner” and the “best performing country” program receive incentive bonus
payments; and (ii) improve the partners’ capacity around data management based on the findings
from the verification exercise.
The main objectives of the exercise were to:
Verify the quality of reported data for key indicators at selected sites;
Assess the ability of data management systems to collect and report quality data; and
Develop recommendations for strengthening the program’s M&E systems.
Approach
This project illustrates Khulisa’s experience in carrying out Data Quality Audits (DQAs) in multiple
African countries and across multiple implementation organizations. Khulisa conducted DQAs at the
head offices of the program partners, i.e. Marie Stopes International, Population Services
International (PSI) and the International Planned Parenthood Federation (IPPF), plus at supported
facilities in the four countries. Over the two rounds of assessments, Khulisa
Conducted 262 site visits.
Reviewed 5 indicators per round
Interviewed over 286 people
Assessed the data management systems at site and partner country office levels across 5
functional areas:
- M&E Structures, Functions and Responsibilities
- Indicator Definitions
- Data Collection/Reporting Forms and Tools
- Data Management Processes
- Links with National Reporting Systems
Verified program data for each indicator at each site.
Calculated performance scores for each country and partner
Documented strengths and weaknesses of each indicator’s data management system.
Recommended improvements to data quality in the 4 countries by partner and indicator.
Trained CCS&PT partners in conducting Data Verification (round 2 only)
Impact:
Khulisa provided each country program and each partner with feedback on (i) their Data Verification
Factor (DVF) by channel and indicator (i.e., over-reporting or under-reporting), and (ii) the strengths
and weaknesses of their Data Management System.
Overall, the CCS&PT partners found the data verification exercise very useful for strengthening their
M&E systems and improving reporting on CCS&PT services delivered.