|
|
Module 5: Tools for Mainstreaming Gender in Transport
5.14. Monitoring and Evaluation
Flexible planning for gender responsive transport programs is guided
by gender monitoring and evaluation to enable adjustments, establish
accountability and ensure commitment to achieving gender-specific priorities.
Monitoring and Evaluation Check List
Review the monitoring and evaluation process to ensure
that a gender responsive approach is implemented.
- Is gender integrated into the Management Information System
(MIS)?
- Are there gender indicators to measure change?
- Does the Project generate gender disaggregated data on:
- Safety
- Opportunities, benefits
- Participation, decision-making
- Positive and negative impacts on mobility, access and
affordability
- HIV/AIDS and health related risks
- Are gender-focused studies and assessments planned for the
project? How will the findings feed back into the project?
- Have in-country gender M&E specialists been identified?
- Is monitoring and evaluation participatory? How are stakeholders
involved?
- How are project effects and impacts on women and men measured?
|
Gender-Responsive Monitoring and Evaluation System
Creating a gender-responsive monitoring and evaluation system requires
appropriate baseline data, relevant indicators, and sustainable mechanisms
for evaluation. Projects require:
- Baseline data on travel and transport burdens and constraints of
women, children and other family members prior to the start of the
project.
- Women's and men's unsatisfied transport needs.
- Levels of women's involvement in project identification and
design.
- Reasons/constraints affecting women's use of the services,
including economic and cultural.
- Feedback on how services can be modified to make them more
responsive to the needs of women.
- Health and HIV/AIDS awareness and access to services and treatment.
- Changes in women's travel and transport as a result of the project.
- Assessment of the relative contribution of different project components
and interventions to the benefits produced for women, men and boy
and girl children.
- Extent of implementation of gender specific inputs and actions
in the project design.
- Implementation, effectiveness, and cost-effectiveness of non-transport
interventions (provision of water, grinding mills, etc).
Defining Indicators
The purpose of indicators is to obtain accurate and consistent estimates
of project performance and the changes and impacts produced. All concepts
must be sufficiently and precisely defined to be measured and so that
it is possible to collect the required information.
Good indicators:
- Measure the key elements they are intended to study or describe.
- Clearly defined and unambiguous so that different people
will give the same rating or value.
- Where possible, numerical or quantifiable so that changes
can be measured.
- Simple and economical to use.
- Easy to interpret and understand.
- Based on data accessible from existing sources whenever possible
(census, national surveys, Demographic and Health Surveys (DHS),
Living Standard Measurement Survey (LSMS), etc.)
|
Types of Indicators
1. Project
Cycle Indicators
- A project must define a set of measurable indicators
for each stage of the project cycle.
- Project design and input indicators.
- Project implementation indicators.
- Project output indicators.
- Project impacts indicators.
- Project sustainability and replicability indicators.
|
2. Contextual
Indicators
- Indicators for analyzing the institutional context.
- Indicators of the social and economic characteristics
of the communities affected by the projects.
- Indicators for analyzing the economic and political
context.
|
3. Project
Design and Inputs Indicators
Relate to project planning and resource allocation
Examples:
- Use of gender-disaggregated data in project planning
to identify differences in roles of women and men.
- Transport constraints on men's productive roles and
women's economic, domestic and community management
roles addressed.
- Women's and men's 'latent' transport and travel needs
addressed.
- Women's and women's groups' involvement in the data
collection process and the effectiveness of the data
collection methods used in detecting women's transport
needs and priorities.
- The economic and cultural issues affecting women's
and men's access to transport and services identified
and addressed.
- Project staff provided with skills in gender analysis
and mainstreaming
- Female staff identified to facilitate women's participation
in the project.
- Overall structure set up to encourage staff to address
gender in their projects.
- The existence of guidelines to address gender.
- Gender sensitive criteria formulated for selection
of participants in RTTP activities.
- Include HIV/AIDS indicators related to awareness,
access to health services, treatment and counseling.
These indicators all need to be accounted for in progress
reporting by the project.
|
4. Project
Implementation Indicators
Monitor how resources are used to achieve project objectives
Examples:
- Gender responsiveness of institutional arrangements
and delivery systems for inputs.
- Participatory project planning with women and men
in communities.
- Including local women and men in road construction
and maintenance.
- Procurement requirements concerning the target groups.
- Methods of administering small loans for IMT's that
provide access to women as well as men.
- Training, capacity building and methodologies used
to introduce new forms of transport, such as donkey
or bicycles to women and men.
- HIV/AIDS awareness campaigns for workers and communities
and activities promoting access to health services,
treatment and counseling.
|
5. Project
Output Indicators
Measure gender sensitivity of project outputs.
Examples include:
- Increase in number of women selected to participate
in RTTP activities such as road or path construction
and maintenance.
- Increase in ratio women to men using IMTs.
- Increase in ratio of women to men owning IMTs.
- Increase in ratio of women to men with small loans.
- Increase in HIV/AIDS awareness, access to health services,
treatment and counseling.
|
6. Project
Impact Indicators
Measure the short-term or long-term impacts resulting from
each of the project outputs.
Examples:
- Reduced time spent on water and firewood collection.
- Increased time spent by women and men on productive
activities.
- Reduced time and costs for women and men taking goods
to the market.
- Increased income for women and men.
- Increased enrollment and retention of girls and boys
in primary school.
- Reduced number of rape and child abductions en-route
to school.
- Increased number of women and men entrepreneurs on
project roads.
- Increased number of IMT producers who are aware of
the travel and transport needs of women, children and
elderly.
- Increase in number of gender-sensitive IMTs.
- Greater role for women in community based decision
making.
- Change in community perception of women's capabilities.
- HIV/AIDS awareness outreach, health service access,
numbers of people receiving treament.
|
7. Project
Sustainability Indicators
Measures ability to continue to operation of a transport
program after external funding has ceased.
- The creation or strengthening of organizations capable
of managing the operations and maintenance of the project.
- The capacity to collect and administer service charges
and obtain other sources of revenue to cover cost of
operations and maintenance.
- The provision and efficient utilization of community
labor in routine maintenance and upgrading.
- Access to the project and its benefits by all sectors
of the target population.
- Continued contribution of outside groups (both government
and NGOs) to their agreed responsibilities for operations
and maintenance.
- Continued access to HIV/AIDS activities, health services,
treatment and counseling.
|
8. Indicators
for Analyzing the Economic and Political Context
The social and economic context should be monitored because
changes affect the implementation process and the impact
of the project on the beneficiaries. Some of the indicators
to monitor are:
- Major travel and transport patterns and needs of
women and men in different community social groups.
- Major economic activities of women and men in theses
groups in the communities and how effectively current
transport systems respond to their needs.
- Changes in the local economy, availability of raw
materials, loans for agricultural activities, employment
patterns, etc.
- Government policies and laws affecting the transport
sector.
- New development agencies being introduced in the
area and the impact of their work on the project.
- Access to HIV/AIDS awareness, health services, treatment
and counseling.
|
9. Indicators
for Analyzing the Institutional Context
Changes in the organization or operation of government agencies
or NGOs involved with the operations or maintenance of the
project can have important impacts on how well the project
operates or is maintained and on who benefits.
Possible indicators include:
- The frequency with which each agency visits the community
or meets with community representatives.
- Agencies use of participatory approaches.
- Creation of institutional capacity to address social
issues and HIV/AIDS.
- The degree of compliance with the agreed commitments.
- Agency staff who speak local languages; women staff.
- Coordination and communication among the agencies.
- Political or administrative change (such as elections,
staff reorganization) which have affected the operation
of any agencies.
|
10. Indicators
of Community Characteristics
Projects with similar designs and resources may operate
differently and have different impacts in different communities
due to the social and economic characteristics of each community.
Some of the indicators or variables to be taken into consideration
in the analysis include:
- Tribal and ethnic characteristics of the community.
- Degree of tribal/ethnic diversity or cohesion.
- Household composition and particularly the proportion
of single-parent households due to war, disease (particularly
HIV/AIDS) or migration.
- Economic dynamism of the community (male and female
unemployment or under-employment, average household
income, trends in prices and income from primary products,
etc).
|
|
Checklist for Gender Integrated
M&E Studies
1. Justify
Need for Study
- Why is the study being conducted?
- Who are the clients? (include both women and men).
- What is the problem or what information is needed?
(apply gender perspective).
- What decisions or actions will be taken? (apply gender
perspective).
- When are the results needed?
- Who are the stakeholders and what are their views
and priorities? (include views and priorities of women
and men).
- Conduct exploratory study (if necessary) to understand
the problem.
|
2. Study
Requirements
- What type of study is required (input monitoring,
process monitoring, output monitoring, etc)?
- What is the time-frame and when are the results needed?
- Can the study be conducted at one point in time or
is it necessary to collect information at different
points in time?
- Exactly what information is needed and how will it
be used (collecting information to understand a problem,
feedback on problems, evaluating the impact of a project,
assessing the accessibility to different population
groups)?
- How precise must the information be?
|
3. Designing
the Study
- Define the group (or groups) to be studied and select
a representative sample which will cover men and women
all of the groups (age, ethnicity, class etc).
- List information to be collected.
- Select the data collection methods.
- Preferably use a multi-method approach including
participatory methods.
- Design and test gender sensitive data collection
instruments.
- Prepare a gender sensitive interview guide (if required).
- Include budget and time to return to the field (if
necessary) once the draft report has been discussed.
|
4. Conducting
the Study
- Selection of the gender sensitive supervisors and
interviewers.
- Organization of data collection and gender sensitivity
training (if required).
- Data collection.
- Data quality check.
|
5. Data
Analysis and Report Preparation
- Analyze data (include gender analysis).
- Include consistency check to assess the validity
of the information.
- Prepare a draft report.
|
6. How
to Ensure the Study will be Used?
- Discuss the draft report with women and men stakeholders
and obtain feedback.
- Include consultations with the communities affected.
- Develop a dissemination strategy to ensure the report
will reach and will be understood by all stakeholders
and possibly the general public.
- Combine written reports with workshops or briefings.
- Involve women in the formulation of an action-plan
which describes how the findings of the study will be
used.
- Make sure that project implementers follow up on
the action plan implementation.
|
|
Monitoring and Evaluation Resources
See Module 6 for a complete listing of gender and transport resources
organized by type of resource and issues. The list below includes resources
on topics presented in this section of Module 5.
- A
Gender Responsive Monitoring and Evaluation System for Rural Travel
and Transport Programs in Africa: A Handbook for Planners, Managers
and Evaluators. P. Maramba and M. Bamberger. World Bank,
2001.
- Rural Transport Training Materials CD-ROM. Module 5 Social
and Environmental Issues. Session 5.1: Social Benefits of
Rural Transport; Session
5.2 Women and Rural Transport in Development; 5.3
Transport and Sustainable Rural Livelihoods. DFID, World Bank,
SSATP, and TRL Ltd., 2004.
- Annotated
Bibliography on Gender Monitoring and Evaluation and Indicators.
World Bank, 2001.
- Manual
for Community-Based Performance Monitoring. World Bank,
2004.
- Engendering
the Logical Framework. Hambley Odame. ISNAR, 2001.
- Measuring
Capacity. UNDP, 2005.
- Rural Access
Index: A key Development Indicator. World Bank, 2005.
- Evaluating
Transportation Equality.T. Litman. Victoria Policy Institute,
2006.
|
© 2006 The World Bank, All Rights Reserved.