Study Goals & Lines of Inquiry
The overall evaluation design (including baseline, midline, and endline) is focused on the program lifecycle, measuring efficiency, relevance, effectiveness and sustainability. This is primarily an outcome- focused performance evaluation that examines key performance benchmarks starting from the intermediate outcome level of the Program Strategy Map. Although some process and near-term outcome results will be considered in order to provide context to findings and examine how implementation mechanisms affect the achievement of results at midline and endline, this evaluation will not be focused on evaluating the implementation itself and near-term level results. A full study evaluation matrix can be found in the Annex.
Study goals
- To assess the baseline context and conditions related to the effectiveness of program implementation against intermediate and long-term outcomes articulated in the W+W Program Strategy Map
- To identify key insights or discussion points to help inform program strategy and the scalability of related future implementation
W+W Program Indicators
This study is designed to provide baseline values and target-setting guidance on the following W+W program long-term outcome indicators.
| Indicator Name |
|---|
| 1. Lives saved estimate |
| 2. Effects of water management on productivity and stress |
| 3. Percentage of households reporting correct water treatment practice |
| 4. Percentage of child caregivers and food preparers demonstrating appropriate handwashing behavior |
| 5. Number of people gaining access to basic/improved water service as a result of USG assistance |
| 6. Number of people receiving improved service quality from existing basic or safely managed water service as result of USG assistance |
| 7. Number of people gaining access to a new basic sanitation facility due to USG assistance |
| 8. Demand for improved sanitation among non-adopter households in program areas |
| 9. Demand for improved water service among non-adopter households in program areas |
Main Evaluation Questions & Lines of Inquiry
The study's focus, while driven by program outcome indicators, was broadened to provide additional context for program strategy and implementation. At baseline, the study seeks answers to the following main evaluation questions and related sub-lines of inquiry:
| Overall Study Main Evaluation Question | Baseline Main Evaluation Question | Baseline Lines of Inquiry | |
|---|---|---|---|
Water and Sanitation Access |
To what extent has the W+W program affected adoption of key WASH practices in households engaged through programming? |
What is the current level of correct WASH practice adoption? |
Current improved water source access |
|
Current improved sanitation facility access |
|||
|
Current correct handwashing practice |
|||
|
Current level of correct water treatment and storage practice |
|||
|
Current level of correct human waste management practice |
|||
Water and Sanitation Improvement Demand |
To what extent has the W+W program affected level of demand among households in target areas for improved water, sanitation, and hygiene? |
What is current demand for WASH improvements? |
Current level of demand for water access improvements |
|
Current level of demand for sanitation improvements |
|||
Water and Sanitation Financing Demand |
How did household level access to financing for WASH and the ability to invest in WASH assets and services change over time in households targeted by the W+W program? |
What is the current demand for WASH financing? |
Current demand for water financing |
|
Current demand for sanitation financing |
|||
Water Management: Productivity & Health Anxiety |
To what extent did the W+W program contribute to improved well-being in target communities? |
What is the current level of anxiety and associated costs of WASH management in W+W households? |
Current level of stress and productivity due to WASH management |
|
Current time and costs associated with WASH management |
|||
Women's Empowerment & WASH |
How did women's agency and self-efficacy in WASH decision making change over time in households and communities engaged through programming? |
What is the current level of women's self-efficacy and women's agency in WASH decision making? |
Current levels of women's agency in WASH and self-efficacy |
|
Barriers to WASH financings factors in household WASH decision making |