Capacity Assessment and Monitoring in CD Support Projects in Solid Waste Management Sector

Similar documents
JICA s Cooperation for the 3Rs JICA. 30/10/2006 Global Environment Department. Implementation of 3R s program in a school, Malaysia

Summary of Evaluation Results

Enhancement of International/Regional Partnership

Japan International Cooperation Agency (JICA), 5-25 Nibancho, Chiyoda-ku, Tokyo

City Report. (Draft) < Dhaka South, Bangladesh >

Economic and Social Council

Improvement for Enterprises in the Republic of Costa Rica Fields: Private sector, development, industrial technology

JICA s Approach on Waste Management

Final0501. Contents of Report

Summary of Terminal Evaluation. 1.Outline of the Project. Management for the Municipality of Panama in the Republic of Panama

Evaluation of the JICA Partnership Program

An Overview of ODA Evaluation. 1.1 Development of ODA Evaluation in Japan Japan s Measures on ODA Evaluation... 4

Public Involvement and Mobilization for Promoting 3R Initiative in Hanoi City - Lessons from 3R Initiative Project in Hanoi City

Review of the First Annual Meeting of African Clean Cities Platform and relevant activities of JICA in Africa

Situation of Municipal Solid Waste Management in African Cities - An Interpretation of the Information provided by the First ACCP Meeting -

Basic Plan for Monitoring Audit Firms in Fiscal 2016

JICA Cooperation for SWM and 3R in Asia with special reference to WEEE/E-waste management

Project for Strengthening Operation and Maintenance of

Country Report. (Draft) < Indonesia>

Proceedings of 2011 World Congress of International Solid Waste. Association (ISWA), October 17-20, 2011, EXCO Daegu, Korea

Japan s International Cooperation for Resource Efficiency and the 3Rs

United Nations Development Programme GUIDELINES FOR EVALUATORS CONTENTS

JT Corporate Governance Policy

City Report. (Draft) < Guwahati, India>

Division in charge: JICA Bangladesh Office Total cost (estimated at completion of the Project): 590 million JPY (Include main body)

Draft concept note for a household waste partnership

City Report. (Draft) < Shimla, India>

Summary of Terminal Evaluation

The Evaluation Study on the Japan Overseas Cooperation Volunteers (JOCV) Program. Final Report (Summary)

Asia 3R Conference 30 October 1 November 2006, Tokyo, Japan. Activities by UNCRD. Kazunobu Onogawa, Director

Summary of Final Evaluation

Terms of Reference Support of UNDAF process, Mexico

Corporate Governance Guidelines

G4 DEVELOPMENT. Document 2 of 12 Statistics: Quantitative Online Feedback. Second G4 Public Comment Period: Submissions.

Chiyoda Corporation Corporate Governance Policy (Revised on June 23, 2016)

Evaluation of the Contribution of UNDP to Environmental Management for Poverty Reduction ( :The Poverty and Environment Nexus)

On the Revision of the Standards and Practice Standards for. Management Assessment and Audit concerning Internal Control

MODEC, Inc. Corporate Governance Guidelines

Introduction of LPP/LPPE and ESC_GL

JICA s Mid-term Plan/Annual Plan for Fiscal 2013

Public Participation in Environmental Planning in the Great Lakes Region

Policy and Strategy for Capacity Development in the Water Sector

Background Organization: GOI UNDP Project Governance and Accelerated Livelihoods Support

UNLIREC TERMS OF REFERENCE

Terms of Reference (TOR)

SUMMARY RESEARCH REPORT

RATIONALE, SCOPE AND APPROACH

OUR CITY, OUR FOOD Strengthening Food Systems through Local Action

Fundamental Policy on Corporate Governance

Indicator One Country Ownership and Results

Workshop II Project Management

Road map for the PMDA International Vision April 2013 Pharmaceuticals and Medical Devices Agency, Japan 1

REPUBLIC OF KENYA MINISTRY OF WATER AND IRRIGATION (MWI) WATER SECTOR TECHNICAL GROUP (WSTG)

Review and Improvement of CSR Activities

JICA s Efforts in 3R & Solid Waste Management; Good Practice and Lessons Learned

Dictionary of Functional Competencies for Career Banding

1.Background JICA PROJECT BRIEF NOTE. May 2014

A joint collaboration between Centre for Responsible Business and the Green Electronics Council

WORLD INTELLECTUAL PROPERTY ORGANIZATION GENEVA INTERNAL AUDIT AND OVERSIGHT DIVISION INTERNAL REVIEW ON PROGRAM PERFORMANCE REPORTING PROCESS

Trade-Related Assistance: What Do Recent Evaluations Tell Us?

Country Report on Waste management in Sri Lanka Status, Achievements and Challenges

Knowledge Lessons : Waste Management

UNITED NATIONS DEVELOPMENT FUND FOR WOMEN JOB DESCRIPTION- Monitoring And Evaluation Officer. Programme Officer Monitoring & Evaluation

Small modular reactors deployment and their applications for embarking countries

Japan s New Action Plan towards a Global Zero Waste Society 1. Introduction

Summary of Terminal Evaluation

INDIVIDUAL CONSULTANT PROCUREMENT NOTICE

Bremen Overseas Research and Development Association. Key elements of our work

Thorough Enforcement of Compliance

STAKEHOLDERS ANALYSIS REPORT

PROCUREMENT NOTICE. National Individual Consultant (IC): Capacity Building Needs Assessment. Date of issue: 03 August (Re-advertisement)

Corporate Governance Guidelines

HUMAN AND INSTITUTIONAL CAPACITY-BUILDING FOR CONFLICT MITIGATION

2.1 Specific objectives of the evaluation The specific evaluation objectives are:

Request for Proposal Urban Consultant to SymbioCity Project in Tunisia

THE COLOMBO PLAN. (Colombo Plan Gender Affairs Programme) Terms of Reference

DRAFT REPORT. Responses to the joint survey on New approaches to Capacity Development and Future priorities

COMMONWEALTH JOURNAL OF COMMERCE & MANAGEMENT RESEARCH

TERMS OF REFERENCE. For. The Design of a Monitoring & Evaluation System to track the Progress of the CARIFORUM-EU EPA Implementation

City Report. (Draft) < Dhaka South>

Response to the joint survey on New approaches to Capacity Development and Future priorities

The Capacity Development Project for Non Revenue Water Reduction in Jordan Summary Sheet for Result of Evaluation Study after the Project

ESCAP/RFSD/2018/INF/3

GUIDING FOR ACCOUNTABILITY:

Evaluation of FY2014 Operating Results for Japan Aerospace Exploration Agency (JAXA)

Working in Environmental Action Research in Japan. Simon Gilby Policy Researcher, Kitakyushu Urban Centre (Sustainable Cities)

Terms of Reference IPC Compliance Review Policy and Process

Capacity building supporting long-range sustainable nuclear energy system planning

Example 2. Development of Waste Management Strategy and Action Plan of Phnom Penh City, Cambodia. Key Challenges and Policy Responses

Terms of Reference UNITED NATIONS PERCEPTION SURVEY IN RWANDA

SAI Performance Measurement Framework Implementation strategy

UNITED NATIONS CHILDREN'S FUND (UNICEF) CALL FOR INSTITUTIONAL EXPRESSIONS OF INTEREST (EOI)

Huge-scale illegal dumping of waste Accumulation of hazardous waste such as PCB

People s Republic of China: Research on Innovative Mechanism for Open Agricultural Investment

TIPS PREPARING AN EVALUATION STATEMENT OF WORK ABOUT TIPS

United Nations Development Programme South Sudan. Terms of Reference Review of Rapid Capacity Placement Initiative (RCPI) May 2012

Compliance. Initiative Policy. Basic Ideas. 69 Activity Reports

Evaluation of the Feedback Mechanism of Japan s ODA March 2016 OPMAC Corporation

VACANCY ANNOUNCEMENT

Template: Organizational Capacity Assessment

Transcription:

Paper presented in the LenCD Forum Addressing the Paris Declaration. Collective Responsibility for Capacity Development: What works and What doesn t, October 3 to 5, 2006, Nairobi Capacity Assessment and Monitoring in CD Support Projects in Solid Waste Management Sector Mitsuo YOSHIDA Institute for International Cooperation, Japan International Cooperation Agency (JICA), 10-5, Ichigaya Honmura-cho, Shinjuku-ku, Tokyo, Japan Yoshida.Mitsuo.2@jica.go.jp Abstract The following three key questions will be discussed based on the field experiences in JICA CD Support projects in solid waste management (SWM) sector: What is the definition of the capacities in SWM?, How to assess the capacity in SWM?, and How can we use the capacity assessment method for monitoring the progress of CD?. 1) Definition of the capacities in SWM The required capacities in the SWM can be understood in terms of three levels: individual, organizational, and institutional/societal. In most countries, SWM services are carried out within a public administrative framework in which the sanitation, conservancy, and/or environment divisions of municipality/local government plays a role as implementing organization, thus the capacities at these three levels are mainly considered from the view point of the implementing organization. A table for required capacities in SWM will be presented. 2) Capacity Assessment in SWM The key to project success lies in the stages of project design and goal-setting, both of which require detailed consideration. In general, the aid requested from the governments and agencies of developing countries are often vague and do not necessarily based on a clear understanding of the problem to be solved. Therefore, in designing projects, it is necessary to conduct background study in advance in order to assess the problems faced by the recipient countries and understand the current state of capacities to make it possible to solve such problems. On the basis of understanding of required capacities in SWM, capacity assessment identifies the areas of capacity to be improved or newly developed to effectively deal with specific problems concerning to SWM. The process of comparing the results of capacity assessments and the SWM problems to be solved clarifies various points: which area of the capacities is lacking that is causing the problem; what existing capacities can be harnessed to contribute to solving the problem; and which area of capacities should be given priority for improvement. The main tool for the capacity assessment in JICA projects in SWM sector is the survey and interview using several checklists. Various checklists and their applications in JICA projects will be presented (El Salvador, Oceania). 3) Monitoring the progress of CD support projects in SWM Capacity assessments not only provide an important framework for project design, but also present a useful perspective in monitoring the achievements in the phase of project implementation, and offer a practical tool in the phase of project evaluation. Once technical cooperation projects are initiated, performance-based or result-based indicators, e.g. increase in the waste collection rate, reduction in environmental pollution through improved landfills, are devised in accordance with the result of initial capacity assessment and goals of the project. Project evaluation is performed based on such result-based indicators, which seeks the 1

attainment of specific outcomes within a set time frame through the project. Some cases of such performance-based or result-based evaluation in SWM projects (Vientiane City, Dhaka City) will be presented. However, it should not be disregarded that such an approach only measures the performance against result-based indicators. The concept of CD takes a more process-oriented approach instead of focusing too much on the outputs (product-oriented approach). Nonetheless, setting indicators that evaluate the progress of CD is in fact a difficult process. It is necessary to identify changes to factors whose impact may be somewhat difficult to observe and to recognize them as outcome. Such factors can include motivation, leadership, adaptability, cooperativeness, and other factors closely associated with the recipients self-initiative and ownership. Changes in these factors are, for example, the recipients becoming more active in problem solving, more capable of exercising creativity to consider appropriate technology, and more self-reliance. Factors that can help assess the level of self-initiative and ownership of the recipient countries are not only important in measuring the progress of CD efforts, but also indispensable in ensuring sustainability. Some trial measures for such CD monitoring at individual/organizational levels using monitoring sheets, self-monitoring, and workshop monitoring will be presented (Dhaka City, Havana City). Introduction The solid waste management (SWM) sector is a field in which JICA has been providing extensive technical cooperation. In the last 10 years, 39 Development Studies 1 were conducted, more than 30 grant aid projects were implemented, over 75 experts and 27 volunteers were dispatched, and 13 training courses were provided (implemented in fiscal years 2002 and 2003). Much of the support has focused on hardware requirements, such as providing waste collection vehicles and heavy machineries for landfill equipment and constructing waste treatment facilities, as well as on non-physical requirements ( soft components ), such as providing SWM training to technicians, conducting technology transfer activities at local sites, and formulating SWM master plans. These technical cooperation activities have depended more or less on inputs by the aid providers (donors). While successful cases contributing to the improvement of SWM practices have been accumulated, it cannot be denied that there have also been cases demonstrating very limited aid effectiveness, impact, and sustainability: dysfunctional and ill-maintained hardware (equipment and facilities) creating a ruin of aid equipment ; training and software (knowledge and technology) not always found to be useful in the actual practice of SWM; and master plans and other formulated plans falling through without being realized. For example in JICA s experiences, even including the partially implemented ones, less than half of the SWM plans (master plans and action plans) formulated as a result of 39 Development Studies have actually been launched and implemented. In the course of examining how to ensure more effective aid and that such efforts contribute to improving the abilities of the recipient countries, the approach of capacity development (CD) emerged to provide a framework for the future direction of aid cooperation (UNDP, 1997). Considering the abilities required in developing a sustainable SWM system as an integration of capacities at the individual, organizational, and institutional/societal levels, this approach examines effective aid that ensures the improvement of overall capacity and highlights the recipients initiative and ownership. 1 The term Development Study in JICA program indicates a technical cooperation in planning sector, such as formulation of a master plan, action plan, and priority project. 2

In particular, important perspective in the CD approach in SWM sector is to address the improvement of capacities at the institutional/societal level. This aspect has been somewhat undermined in past aid and cooperation projects in SWM. For example, just as in source segregation of solid waste and 3Rs (Reduce, Reuse & Recycling) efforts in Japan, without the active participation and cooperation of local communities and citizens, the efficiency and effectiveness of SWM services generally carried out by local governments can deteriorate drastically. A consensus among the local communities is indispensable to the implementation of projects, such as those for constructing solid waste treatment facilities and final disposal sites. Furthermore, it can be said that the issue of waste is a social phenomena closely linked to urbanization and economic problems. Such links between SWM and social or economic concerns can be clarified by taking into account the CD concept. In this paper, I will try to discuss the following three questions: What is the definition of the capacities in SWM?, How to assess the capacity in SWM?, and How can we use the capacity assessment method for monitoring the progress of CD?, based on the experiences of the Development Study and pilot projects in Dhaka City, Bangladesh and other CD support projects on SWM sector in developing countries. 1. Definition of the Capacities in SWM The required capacities in the SWM can be understood in terms of three levels: individual, organizational, and institutional/societal (JICA,2005). In most countries, SWM services are carried out within a public administrative framework in which the sanitation, conservancy, or environment divisions of municipality/local government plays a role as implementing organization, thus the capacities at these three levels should be mainly considered from the view point of the implementing organization. The following identifies the areas of capacity that need to be developed in the SWM sector. Then, with reference to a pilot case that performed capacity assessments and monitoring, it examines what needs to be done to improve the capacities pertaining to SWM practices. (1) Capacities at Individual Level Individual level capacities refer to the knowledge and skills of personnel engaged in SWM practices. It also includes the individuals determination, ability to act, and sense of responsibility toward achieving their own objectives in SWM by making use of their knowledge and skills. Individuals engaged in SWM services at the field level in developing countries often have a low social status and inadequate education. For example, in the case of Dhaka City, Bangladesh, most workers come from a lower rank of traditional caste system and are illiterate or have had no formal education. Such cases not only entail many challenges to improving the level of practical knowledge and skills, but also require providing basic knowledge about sanitation in relation to their working environment. In contrast, administrative officers, who are engaged in the planning, management, and operation of administrative tasks for SWM services, tend to fail to apply their knowledge to actual practices or lack the extensive know-how required to deal with the situation in accordance with the specific conditions of developing countries even though they have sufficient educational background or, in some cases, have built their academic career by studying abroad. In addition, in order to functioning properly, the administration must address ethical factors, exercising its will and fulfilling its responsibility. Capacity at the individual level is the key element in considering capacities at the organizational and 3

institutional/societal levels which are discussed below. Provided in the form of technology transfer and training, previous JICA technical cooperation activities have conventionally focused on improving capacities at the individual level. (2) Capacities at Organizational Level Organizational level capacities refer to the physical, human, and intellectual assets, leadership, decision-making system, management frameworks, and organizational culture in order to achieve their predetermined objectives in SWM. SWM practices are based on teamwork instead of each individual s separated efforts. This naturally calls for a certain organization that implements the undertakings. SWM cannot be put into practice without the existence of human assets, or an organization of individuals possessing the required expertise, management skills, and planning ability, whether in practice SWM is performed by municipal/local administrative bodies, private firms, or NGOs. Equally important is the mechanism that develops such human resources. At the same time, it is necessary to possess the hardware or physical assets, such as the facilities, equipment, land, and funds, required to provide the components of SWM practices, such as waste collection, transportation, intermediate treatment, and final disposal. In association with the hardware, or physical assets, the organizations must also have the software, or intellectual assets, such as statistical information (e.g. waste generation, waste stream), technical literature, manuals, and research data with regards to SWM technologies and systems. The SWM organizations are also required to have an appropriate form, management system, and leadership for properly utilizing the physical, human, and intellectual assets mentioned above. Management and leadership are not only related to the capacities of the leaders or individuals of the management team, but are also strongly associated with the sharing of common norms and attitudes toward goal attainment among all members of the organization. (3) Capacities at Institutional/Societal Level Institutional/societal level capacities in SWM refer to the social background and conditions, and frameworks that make possible the utilization of capacities at the individual and organizational levels for the proper functioning of sustainable SWM system. It includes policies, institutional setup, social capital, and norms. SWM requires a legal framework, such as laws stipulating the definition of solid waste and the locus of management responsibility, which shall be defined by the central government level. Based on such a legal framework, it is necessary to devise specific rules and regulations (e.g. rules pertaining to the collection, treatment, and disposal of waste, waste treatment standards, and environmental standards) and stipulate the penalties that ensure such rules and regulations are executed, and clarify the control/enforcement authorities involved. The comprehensive SWM implementation also calls for policies on environmental control and urban management, and specific policy objectives, as well as the development of the administrative bodies that promote them. Certain economic frameworks and levels of economic development are conditional on establishing SWM systems. The infrastructure, such as the transport networks and telecommunication, is also included as a part of the capacity required at this level. In addition to those within the frameworks of institution, policy, and economy, the capacities at institutional/societal level also involve SWM-related social activities by community-based organizations (CBOs) 4

and NGOs, as well as formal or informal waste recycling markets and waste recycling industries. Furthermore, when viewed from a broader perspective, the social system in SWM also involves a variety of elements: education about SWM and the environment in schools and in the society; systems ensuring that the views of local communities are taken account of (good governance); active participation by local communities (partnerships); networks; and social ownership, reflected in public consensus and willingness to work together as a whole to rationally carry out SWM practices. The institutional/societal level capacities in SWM also include rather informal aspects, such as the customs, taboos, and norms concerning waste in given society, which can be collectively referred to as social capital. From the view point of implementing organization of SWM (i.e. public administration in local government/municipality) the capacities required for SWM are summarized at the three different levels as shown in Table 1. The relationship among different three levels of capacities is schematically illustrated in Figure 1. Table 1: Capacities required for SWM (Yoshida in JICA, 2005) 5

Fund allocation from govt. and institutional setup Laws, By-laws, Regulations on SWM Cooperation with private firms Public awareness, Participation Institutional & Societal level Organizational level Individual level Knowledge & skill of officer -SWM facilities -Equipment -Organization -Management -Plan of operation Figure 1: Relationship among different levels of required capacities in SWM (modified from JICA, 2006). The organization here is focused on a SWM department in local government/municipality. 2. Capacity Assessment The key to project success lies in the stages of project design and goal-setting, both of which require detailed consideration. To a greater or lesser degree, the aid requested from the governments and agencies of developing countries are often vague and do not necessarily based on a clear understanding of the problem to be solved. Therefore, in designing technical cooperation projects in detail, it is necessary to conduct background study in advance in order to assess the problems faced by the recipient countries and understand the current state of capacities to make it possible to solve such problems. It is important to identify the areas of capacity to be improved or newly developed to effectively deal with specific problems concerning SWM. This process of analysis is called capacity assessment. The process of comparing the results of capacity assessments and the SWM problems to be solved clarifies various points: which area of the capacities is lacking that is causing the problem; what existing capacities can be harnessed to contribute to solving the problem; and which area of capacities should be given priority for improvement. This process is indispensable in identifying the specific goal to be sought in the project. Capacity assessments are also useful in giving definite shape to the overall technical cooperation project. By fully assessing the capacity of the recipient countries or targeted areas, it becomes possible to plan the most appropriate approach in providing inputs that maximize the CD outcome. The concept of capacity assessment offers a more comprehensive frame of reference to PCM workshops. PCM workshops, in turn, ensure ownership on the part of the recipient, which should be respected in capacity development. In short, they are mutually supportive (Figure 2). 6

Figure 2: Relationship between capacity assessment and project design The main tool for the capacity assessment in SWM sector is the survey using several checklists: (1) Checklists for Capacity Assessments Regardless of various states in SWM in developing countries, which may differ according to the country or city, a detailed list of survey items must be prepared in order to comprehensively conduct capacity assessment at all levels. Checklists for the capacity assessment (examples provided in Tables 2 and 3) have been prepared for this purpose. The checklists, resembling the lists of questions previously used in JICA preparatory studies before implementing projects on SWM, have been standardized so that they can be used by any person as a helpful tool for assessing capacities at all levels in SWM. The checklists are compiled based on the understanding of the overall capacities in SWM summarized in Table 1. 7

Table 2: An example of checklist for capacity assessment for municipalities (Check whether information and data have already been obtained on the following items.) 8

Table 2: An example of checklist for capacity assessment for municipalities (continued) 9

Table 2: An example of checklist for capacity assessment for municipalities (continued) 10

Table 3: An example of checklist for overall capacity assessment in SWM 11

Table 3: An example of checklist for overall capacity assessment in SWM (continued) 12

According to what has been obtained through the pilot case in which these checklists were utilized, in cases where the provision of CD support is limited to the SWM division of the local government, the one provided in Table 2 has been found to be more useful as it incorporates detailed field data. On the other hand, in cases where, instead of directly implementing SWM projects, support is provided over a broader range of organizations than just the local government or provided to a central government agency that decides on or gives advice on policy formulation, the comprehensive checklist presented in Table 3 should be more useful. Furthermore, the checklist in Table 3 may also be applied in the environmental sector to deal with brown issues (pollution-related issues). It is unarguable that items to be checked need to be revised or added to reflect the circumstances of each country or city. (2) Case Studies in Capacity Assessment A capacity assessment based on a common checklist sets the standard for assessment and provides a useful tool for conducting extensive studies in the environmental and SWM sectors. This is seen in the wide-ranging studies currently being conducted in Asia, Central America, Oceania, and in West Africa, by JICA. Use of standardized checklists is effective and efficient in terms of three aspects: (i) it assures consistency of the surveys even in cases where project formulation officers do not have the expertise concerning solid waste or where local consultants are employed; (ii) it ultimately serves as a project finding tool that makes the recipient aware of the problems; and (iii) it enables the projects that donors consider of higher priority to be identified from among a number of projects. Since 2004, we have performed capacity assessments making use of these checklists in the survey for the SWM projects in Ulan Bator, Mongolia, in project design studies and preparatory studies for small-scale municipal SWM in El Salvador and the SWM project in Palestine. We also made a capacity assessment survey on SWM in Dhaka City, Bangladesh, in 2001 and 2003, JICA Expert Dispatch and Preparatory Study Mission, using a primitive form of the checklist for assessing the capacities. The following lessons were learnt from these experiences: 1) El Salvador - Focusing the target In the project in El Salvador, by using the checklist in Table 3 to discuss various dimensions of capacities with the organization requesting aid (i.e. an advisory agency to the country s central government), it was clarified that the set project framework, which originally specified JICA to directly provide a technical cooperation to a small-scale municipal association to undertake SWM services, actually made the central government the main target actor of CD initiatives, therefore the originally proposed project design was not appropriate for achieving the objective. As just described, conducting a capacity assessment together with the recipients has the same effect as carrying out a stakeholder analysis, problem analysis, and objectives analysis altogether. It also functions as a facilitation tool or guidelines in project cycle management (PCM) workshops. The capacity assessment for the case in El Salvador was not only useful in project formulation, but also contributed to increasing the understanding of the existing SWM system within the aid requesting country, which contributes fostering its ownership. In other words, it can be said that conducting the capacity assessment was in itself a part of CD support. 2) Dhaka Capacity Assessment and Planning CD In the project to improve the SWM in Dhaka City, Bangladesh, initial request from the Dhaka City 13

Corporation (DCC) was a lack of waste transportation vehicles and heavy machineries for landfill management. However, according to the preliminary study by JICA expert and checklist survey, there is no comprehensive master plan to improve the SWM system in Dhaka and fragmented administration system for SWM in DCC, which resulted in current waste problems in Dhaka City (Figure 3). It was also found that participation of citizen and community was essential to improve the primary collection system in Dhaka City. On the basis of the results of preliminary study and checklist survey, a Development Study for formulating a master plan of SWM, pilot projects on management and community based SWM were launched. Mayor CEO Transport Dept. Engineering Dept. Conservancy Dept. Planning Dept. Store Dept. O&M of Collection Vehicles O&M of Heavy Equip. General Management Of SWM Planning Procurement Figure 3: Organization structure for SWM in Dhaka City before and after the project (Murata, 2005). 3) Oceania and Caribbean islands Score of capacities In the wide-ranging project formulation study for the SWM sector of Pacific island countries and Caribbean island countries, in order to identify areas (island) requiring more attention in terms of aid, items of the assessment were altered in accordance with the local circumstances, evaluated using a numerical indicator with a scale of 1 to 4, and were prioritized based on the results. An example of the score-type checklist is shown in Table 4. In the score-type checklist, items with lower scores indicate insufficient capacity that should be given higher priority in CD support project. Although the appropriateness of the numerical indicator and of the weight given to each evaluation item should be reexamined, the capacity assessment performed in this case provides a valuable approach to the stages of project finding, project design, and sector appraisal in regional project formulation studies. 14

Table 4: An example of checklist (Score table). The table is an excerpt from the complete assessment table that has been prepared on an experimental basis in the preparatory study for the Integrated Management of Urban Solid Waste in Santo Domingo National District. Capacities with regard to the "collection and transportation" of waste are reviewed in terms of five items. There are four rated criteria for each item. The state of affairs is assessed against these criteria and the total score is calculated. (JICA, 2005) 3. Monitoring of CD Support Project Capacity assessments not only provide an important framework for project design, but also present a useful perspective in monitoring the achievements in the phase of project implementation, and offer a practical tool in the phase of project evaluation. Once technical cooperation projects (including Development Studies) are initiated, performance-based or result-based indicators (e.g. increase in the waste collection rate, increase in the waste disposal to landfill sites, reduction in environmental pollution through improved landfills) are devised in accordance with the goals of each project. Project evaluation is performed based on such indicators, which seeks the attainment of specific outputs within a set time frame through the project. Two examples are given from Vientiane and Dhaka projects: 1) Vientiane - Result-based indicator (waste collection rate) monitoring An example is the case of SWM projects in Vientiane City, Laos. In this case a collection rate was set as a result-based indicator for improvement of SWM service activities in the city (Figure 4), where high collection rate could be regarded as an improvement of urban environment. 15

Figure 4: An example of performance-based monitoring: Trend in the volume of waste collection in Vientiane. Data Gap Regarding No. of Trips 900 800 700 600 No. of Trips 500 400 300 200 100 0 01-Sep 03-Sep 05-Sep 07-Sep 09-Sep 11-Sep 13-Sep 15-Sep 17-Sep 19-Sep 21-Sep 23-Sep 25-Sep 27-Sep 29-Sep Date No. of Trip counted at Matuail No. of Trip mentioned in Saidabad Logbook Figure 5: Data gap between the number of trips of waste transport vehicle counted at garage and that at landfill site, in the beginning stage of the pilot project. (JICA,2006) 16

2) Dhaka Result-based indicator (waste disposal rate) monitoring In the Development Study of SWM in Dhaka City, a pilot project was performed for monitoring appropriate disposal of solid waste into landfill sites; where the number of vehicle for waste transport started from the DCC s garage was compared with the number of arrival to the landfill site. The numbers are normally the same, but if the number of landfill site is smaller that that in garage, there is illicit disposal out of the landfill site. The monitoring was done by counterparts by themselves and large gap was observed (Figure 5). Based on the results DCC had applied strict management and control of waste transport vehicle. However, it is important to note that such an approach only measures the performance against the results. The concept of CD takes a more process-oriented approach instead of focusing too much on the outputs (product-oriented approach). Nonetheless, setting indicators that evaluate the progress of CD is in fact a difficult process. It is necessary to identify changes to factors whose impact may be somewhat difficult to observe and to recognize them as outcome. Such factors can include motivation, leadership, adaptability, cooperativeness, and other factors closely associated with the recipients self-initiative and ownership. Changes in these factors are, for example, the recipients becoming more active in problem solving, more capable of exercising creativity to consider appropriate technology, and more self-reliance. Factors that can help assess the level of self-initiative and ownership of the recipient countries are not only important in measuring the progress of CD efforts, but also indispensable in ensuring sustainable development. Some trial measures for such CD monitoring at individual/organizational levels using monitoring sheets, self-monitoring, and workshop monitoring will are given as follows: Table 5: Monitoring sheet for CD at individual counterpart level. 17

3) Dhaka Capacity Monitoring Sheet at Individual Level In the case of Development Study in Dhaka City, Bangladesh, monitoring of CD at individual counterpart were done by the JICA expert team using a monitoring sheet (Table 5), where the whole span of the project divided into shorter time periods 2 and to assess various dimensions of the capacities for specific counterparts. Table 6: Monitoring of Capacity Development at individual level in the final stage of the project (Development Study) (modified from JICA, 2004, 2005, 2006MS). Targets of CDP Selfevaluation JICA team evaluation Joint evaluation DPSC (local government) counterparts Upgrading of the management capacity for SWM A B B Strengthening of the basic knowledge of environment-friendly SWM B A A Acquiring the capacity for planning, design, and O/M of environment- A B B friendly landfills Acquiring the planning capacity for efficient collection and A B B transportation Acquiring the planning capacity for segregated collection B B B Acquiring the planning capacity for middle and long term SWM B B B Acquiring the basic knowledge of the 3Rs B A A Overall B B B CITMA (central government) counterparts Enhancing capacity for establishing legal system to enable environment- B B B friendly SWM Enhancing capacity for the promotion of research and implementation of A A A the 3Rs Enhancing capacity for working out an environment-friendly appropriate B B B technology for landfills Enhancing capacity for working out the criteria for the establishment of B A A environment-friendly landfills Enhancing the capacity for working out the criteria for the leachate B B B treatment Overall B B B 4) Havana Monitoring of Individual-level Capacity Development In the case of Development Study on SWM in Havana City, the project activities of capacity development support were carried out through three sectors, in-house lectures, overseas training courses (Japan and Mexico), workshops, and on-the-job-trainings during implementation of the Development Study. In the beginning stage of the project, each counterpart made CD plans (CDP) based on the assignment and 2 In the case of Development Study, the evaluation term is divided to correspond to the report status (Inception Report, Progress Report, Interim Report, and Draft-Final Report). 18

function in the project. Then three CD monitoring workshops were held during the 2 years project term in order to present the achievement. Based on the workshop activities, self-evaluation by heads of counterpart organization, evaluation by JICA expert team, and integrated evaluation by joint evaluation committee were done for each items in three categories, A (excellent), B (good), and C (fair). The degree of CD at each individual counterpart achieved through the Development Study was evaluated based on the records of activities. Among the items contained in the records, the main items of evaluation were: (i) degree of attainment of targets initially set forth for each individual, (ii) degree of participation and contribution to the Study, and (iii) contents of technology actually transferred (Table 6). The evaluation method is effective to monitor the progress of capacity development at individual level. In addition, in some trial cases, the results of monitoring are shared with the recipients. The use of monitoring sheets is quite effective in depicting the CD progress at individual level through a technical cooperation activity and both the donor and implementing organization can attain an overview of the extent of progress and the impacts. Although there is considerable room for improvement in the evaluation of CD progress, application of quantitative indicators for the evaluation is rather difficult and introduction of substitute indicators (proxies) is under consideration. Under such restrictions, project monitoring in the field is currently expected to generate evaluation results using qualitative indicators. This requires more efforts on the part of field offices and the like to improve and enhance the methods of field monitoring. 4. Conclusions (1) The required capacities in the SWM can be understood in terms of three levels: individual, organizational, and institutional/societal. Clear definition of the capacities is indispensable for capacity assessment and monitoring. (2) On the basis of definition of required capacities in SWM, capacity assessment identifies the areas of capacity to be improved or newly developed to effectively deal with specific problems concerning to SWM. The capacity assessment is a part of, or a framework of, baseline survey in beginning stage of CD support project. Checklists survey is one of the promising tools for the capacity assessment. (3) Capacity assessments not only provide an important framework for project design but also present a useful perspective in monitoring. In the monitoring of project outputs, performance-based or result-based indicators are devised in accordance with the result of initial capacity assessment and project goals. The result-based indicators can depict achieved level of the capacities. (4) However, such a monitoring only measures the performance against result-based indicators. More process-oriented approach in monitoring is crucial instead of focusing too much on the outputs, product-oriented approach. CD monitoring at individual/organizational levels using monitoring sheets, self-monitoring, and workshop monitoring are proposed. References JICA (2005): Supporting Capacity Development in Solid Waste Management in Developing Countries: Towards Improving Solid Waste Management Capacity of Entire Society - Study Report (English Edition). Institute for International Cooperation, JICA, Tokyo. http://www.jica.go.jp/english/resources/publications/study/topical/waste/index.html JICA (2006): Capacity Development (Japanese Edition). Institute for International Cooperation, JICA, Tokyo. http://www.jica.go.jp/branch/ific/jigyo/report/field/200603_aid.html JICA (2006) The Study on Solid Waste Management Plan of Dhaka City, Bahgladesh (Final Report) 19

JICA (2006) The Study on Integrated Management Plan of Municipal Solid Waste in Havana City (Draft Final Report). Yoshida, M. (2006): Dissecting Technical Cooperation in Solid Waste Management from a Capacity Development Perspective. Technology and Development, 19, 1-13. http://www.jica.go.jp/english/resources/publications/study/technology/19.html 20