Questions and sub-questions Indicators Data Collection Methods Information and Data Sources
RELEVANCE
Do the Project design and the choice of activities and deliverables properly reflect and address the needs of the
beneficiaries?
o Is there a correlation link between the Project’s design, activities and deliverables and the needs of the beneficiaries?
Level of knowledge of the beneficiaries of the Project
Level of satisfaction of the beneficiaries with the Project design
Level of satisfaction of the beneficiaries with the Project’s design (activities and deliverables)
Perception of Project managers
Document review Workshops’ summary evaluation
responses
Interviews
Survey
Beneficiaries
Project managers
Number of occasions during which the beneficiaries were able to express their needs during project implementation
Perception of beneficiaries regarding the extent of their needs captured/ reflected in the project design and implementation.
Correlation between the project design and UNCTAD’s mandates
Are the project design and the choice of activities and deliverables aligned with the objectives of Development Account?
Correlation between the project design and the objectives of Development Account
Correlation between the selected activities and the objectives of Development
Were the actual activities and outputs of the project consistent with the overall goals and the intended outcomes?
Correlation between the activities and outputs and intended outcomes
Correlation between assumptions made during the design phase and the actual operating environment of the project
Have the activities achieved or are they likely to achieve planned objectives as enunciated in the
Number of meetings and seminars on trade strategy issues (trade options, trade strategies, trade strategy
Document review Progress reports
Project document
Trade strategy and implementation plan
33 If considered relevant and if they are available during the Geneva mission.
43
Questions and sub-questions Indicators Data Collection Methods Information and Data Sources
project’s logframe and produced the formulation of a trade policy / strategy conducive to poverty reduction with an implementation plan
Existence of draft national trade policy / strategy conducive to poverty reduction, with an implementation plan for each of the concerned Governments (for consideration and possible endorsement)
Nb. of beneficiaries reporting having sufficient capacities to develop trade
Report on submission of national trade policy
Evidence that national development and poverty reduction plans are reflecting priorities of trade strategies
Number of assistance needs and operations identified in the trade
Number of trade strategies build on the diagnostic trade integration study or the
Proposals and requests submitted
Workshops’ summary evaluation
To what extent are project stakeholders
satisfied with the activities delivered and Level of satisfaction of the
stakeholders with the activities Document review Workshops’ summary evaluation responses
44
Questions and sub-questions Indicators Data Collection Methods Information and Data Sources
the quality of the outputs? delivered and the quality of the
outputs? Interviews
Survey
Beneficiaries
Consultants
Project managers
What were the main factors influencing the outcomes of this project?
Lessons learned for replication of the project to other locations
Degree of replicability of the project in other locations
Document review National policy documents
Trade strategies and have the activities been carried out within the planned timeframe?
Existence of a monitoring strategy
Adequacy of monitoring tools to measure results achieved
Level of satisfaction of relevant stakeholders concerning reporting
Level of satisfaction of beneficiaries with UNCTAD’s communication procedures
Have resources and funds been used efficiently, leveraging in-house expertise, previous research and technical cooperation outcomes, existing databases, and other in-house resources of UNCTAD?
Has the project strategy of leveraging partnerships contributed towards the outcomes of the project? How?
Correlation between costs and results
Percentage and cost of personnel time allocated to programme management34
Adequacy of management expenses vs.
operational expenses
Have the project activities been carried out within the planned timeframe?
Correlation between issues dealt with through the project and issues
34 Management expenses: logistics & administration, contractual services, etc.
Operational expenses: Paying for the workshops, paying speakers during the workshops, paying the consultants, etc.
45
Questions and sub-questions Indicators Data Collection Methods Information and Data Sources
two years
Level of satisfaction of beneficiaries
Level of timely completion of planned activities in the beneficiary countries.
Trade strategies
Diagnostic trade integration study
Progress reports
Workshops’ summary evaluation responses
What is the likelihood that the benefits from the project will be sustained following the completion of the project?
Have efforts been made to sustain the knowledge and research result gained in the project for future similar
interventions to be carried out by UNCTAD?
Perception of beneficiaries and managers
Existence and quality of an exit strategy
Level of institutional development through the Project
Level of individual development the Project facilitated
Level of engagement of beneficiaries in the design of activities and
implementation
Level of cooperation with other int'l organization or local implementation
Workshops’ summary evaluation responses
Is the project supported by the national government? Do the government counterparts demonstrate leadership commitment and technical capacity to continue the work initiated by the project?
Number of occasions during which the beneficiaries were able to get involved in project implementation (e.g.: workshops)
Level of participation of the beneficiaries
Document review Project document
Level of satisfaction of the beneficiaries with their involvement in the Project’s initiation and design
Level of senior level beneficiaries/
decision makers involvement in the project (ownership issue)
Level of satisfaction of the beneficiaries with their involvement in the Project’s
Evidence that measures were undertaken to increase participation of women in the Project’s activities
Evidence that gender issues are
Document review Project document
46
Questions and sub-questions Indicators Data Collection Methods Information and Data Sources
integrated in the trade policies /
strategies Workshops’ summary evaluation
responses
Interviews
Surveys
Beneficiaries
Consultants
Project managers
How have the policy makers been sensitized on the gender impact of trade and trade policies? For instance, are they better informed of policy options to promote gender equity?
Perception of policy makers, beneficiaries and managers of the importance in mainstreaming gender equality in their policies and strategies
Document review Project document
Progress reports
Events participants lists
National policy documents
Trade strategies
Diagnostic trade integration study
Workshops’ summary evaluation responses
Interviews
Surveys
Beneficiaries
Consultants
Project managers
47