Kenya: Terms of Reference: Evaluation of the NGO Safety Program (NSP)

1.Background

1.0.What is NSP?

The NGO Safety Program (NSP) for Somalia / Somaliland is a program developed by NGOs, with an aim to support International and National NGOs to operate safely and securely in Somalia / Somaliland.

NSP, initially called the NGO Security Preparedness and Support (NGO SPAS), was established in 2004 by NGOs operating in Somalia / Somaliland. One of the driving forces that gave rise to the program was the targeted killing of five aid workers between 2003 and 2004, and the realization that the operating environment for national and international NGOs was changing rapidly. Today, Somalia is considered as one of the most challenging context in terms of security for NGOs.

1.1.NSP is hosted by an INGO

NSP is a program, not an NGO with a legal entity. NSP is administratively and legally hosted by a volunteering NGO. This means accountancy, funds, and administrative issues (Human resources, contracts) are channeled through the hosting NGO. NSP is fully independent in terms of strategy and operational management, under the direction of a steering committee.

This particular organization ensures NSP remains a program by NGOs, for NGOs. A Similar structure has been adopted by other NGO safety Programs in the world, most noticeably the Afghanistan NGO Safety Office (ANSO), which initiated this model.

The current hosting NGO of NSP is the Danish Refugee Council (DRC). Previously NSP was hosted by Care international. NSP is closely linked with the NGO Consortium (same office, same Steering Committee).

1.2.Donors

NSP is funded by donors and favors a multi donor approach. Donors supporting NSP are the same donors supporting humanitarian actions in Somalia and Somaliland. The present Donors supporting NSP include:Common Humanitarian Fund for Somalia,ECHO, UK Aid / DFID, SDC

1.3.What are NSP Services?

NSP services are articulated around 4 pillars or results, for its current phase:

Result 1: NGOs operating in Somalia have improved their understanding of the Somali security context and can base their decisions on relevant and timely security information and analysis.

This is achieved through activities such as: Daily reports / Weekly reports and quarterly reports, Advisories, regular security briefings, production of Maps, Security Risk Assessments (SRA) etc…

Result 2: NGOs operating in Somalia have built up their capacity in terms of security knowledge and practices

This is achieved through activities such as Personal Security Training (HEIST, first aid training, Country Directors and Security Focal Point specific training etc….

Result 3: NGOs operating in Somalia are supported, on request, in terms of crisis management and evacuations

This is achieved through specific support tailored to the situation.

Result 4: Effective facilitation of SPU services is in place for NGOs operating in Puntland and Somaliland

This is achieved through activities such the follow-up and management of SPU requests, the provision of technical assistance in management of SPUs and the facilitation between different stakeholders (UNDP, NGOs, Local authorities)

2.The Purpose and Objectives of Evaluation

The purpose of the evaluation will be to enable NSP Steering Committee, NGOs as well as NSP Donors, to:

evaluate the impact of NSP on the security of NGOs

The key findings will also help NSP senior management to review and update its strategy.

This evaluation is mandatory as part of NSP agreement with ECHO.

3.Scope of the Evaluation

The scope of the evaluation includes a detailed feedback by NSP beneficiaries on each of its services, and an attempt to quantify its impact on their security. It is also expected the evaluation will analyze the organizational set-up of NSP.

It would be important to visit some key places in Somalia / Somaliland where NSP is present. The successful consultant will have to propose a plan for the visit.

Contacts with the following stakeholders are expected:

NGOs: a representative set of at least 20 INGO and LNGO of the NGO working in Somalia and Somaliland, at both Coordination level and field level.Members of the NSP Steering CommitteeNSP Donors and more broadly the Donor communityOCHA and UNDSS, the natural UN counterpart of NSP in the UNNSP StaffNGO ConsortiumDRC, in its quality of NSP Hosting AgencyIdeally a comparative approach and set of comparison with other similar program in the world (ANSO, GANZO)

4.Evaluation Criteria

The evaluation should effectively answer the following questions under each criteria:

Effectiveness: To what extent were the project objectives achieved at the results level? Did the benefits reach the target group as intended? Were benefits distributed fairly between different types of NGOs?

Efficiency: To what extent are the costs of project intervention justified by its results, taking alternatives into account?

Relevance: To what extent did the project intervention conform to the needs and priorities of target groups ?

Impact: To what extent and at which level (coordination of field) the project intervention has a direct and / or indirect impact on NGO security

Appropriateness: How well did the humanitarian activities respond to the changing demands of the situation; considering the requirements of adaptation, ownership, accountability, and cost-effectiveness?

Coordination: What mechanisms were put in place for coordination with the NGOs, UN, local authorities, donors, and other actors; and how effective were they?

5.Key Tasks:

The key tasks for this consultancy are:

Develop an Inception Report detailing among other things; the process and methodologies to be employed to achieve the objective of this consultancy as stated above. It should include the interview schedules, and important time schedules for this exercise, and present to NSP for review and further inputs.Undertake desk review of the relevant project documents that include the Proposals, Implementation Plans, Project Implementation Reports, NSP strategy documents and any other relevant documents and should take into consideration ECHO evaluation guidelines and standards.Design data collection methodology as appropriate, guided by the international evaluation standards and relevant framework(s).Design, develop, critique (with NSP team) and refine data collection tools including translation to the local Somalilanguage, where appropriate.Carry out data collection, entry and analysis and write up the Evaluation Report. The format of the report shall include the following:Executive Summary

o Summary Table of key issues and recommendations; after Executive Summary

Preliminary pages – Acknowledgment, Acronyms and Table of contents

Main text, to include:

o Background Information: Brief on the Project and context; Evaluation – purpose and objectives; evaluation limitations

o Methodology: Design, Sampling technique and Sample size

o Findings: Analysis based on evaluation criteria and interpretation

o Key accomplishments and Summary of project assessment

o Lessons learnt, Best practices and opportunities for improvement

o Recommendations

Appendices: Evaluation tools, evaluation ToR, sample framework, bibliography, etc.

N/B:*The report will be reviewed and approved by NSP before final payment is released.*

Present the draft report to NSP team for review before producing a second draftPresent a Draft Evaluation Report (2nd draft report) to NSP, NSP Steering Committee and Donors in a workshop to facilitate sharing of evaluation results with a view to incorporate inputs from project stakeholders in the final draft.Submit a Final Evaluation Report to NSP as stated in the Consultancy Contract.

6.Key Deliverables

Soft copy of the Report in two (2) CDs.The consultant will also be required to submit to NSP all study materials including:Soft copies of all data sets both quantitative and qualitativeAll filled quantitative data collection tools and qualitative data recording materials.Any other non-consumable documents/items that will be used in the course of the planned consultancy

7.NSP’s Responsibilities:

The Consultant will be responsible to the NSP Program Manager. NSP staff in the evaluation areas will provide necessary support to the evaluation team, as may be needed.

NSP will provide the following:

Transport to and from the field.Travel insurance to the consultantAll necessary project documents as requested by the ConsultantAccommodation to consultantPay consultancy fees at a mutually agreed rate

The terms and conditions of service will follow DRC terms for consultancies. Payment will be done according to the financial procedures of DRC.

8.Duration of the Consultancy

NSP envisages that the consultancy will take 20 days, from the time the contract is signed. The Consultant/Consultancy Firm should develop a feasible work plan/activity schedule covering a maximum of 20 days and submit as integral part of the proposal for this consultancy.

The successful bidder must commit to accomplish and deliver the consultancy services and deliverables before or on December 15, 2014 by close of business.

9.Expected Profile of the Consultant

For this Consultancy, NSP is expecting to contract 1 lead consultant.

The consultant should have the following:

Advanced degree and experience in development evaluation or social sciencesIn depth experience in security management for NGOs, whether at a country director level or as the main security manager of an NGO.Documented experience in participatory project evaluationBe familiarized, as a regular user, to NSP products or other similar security programsExperience in evaluating other similar security programs is a strong advantageExperience of Somalia is a strong advantageGood interpersonal relation and understanding cultural sensitivitiesStrong analytical and report writing skillsDemonstrable capacity to deliver high quality outputs within the proposed timeframe

If you feel you fit the required profile, please send in an Expressions of interest (EoI), including:

CV (s) with details of qualifications, experience, telephone number and names of three referees,technical proposal that summarizes your understanding of the TOR, the proposed evaluation approach and tools to be used,financial proposal providing a clear and detailed cost estimate andthe foreseen work plan for the days.

Send your application latest by November 15th, 2012via email to david@nspsomalia.orgindicating ‘NSP Consultancy for Evaluation’ in the subject line.

10.Evaluation and award of consultancy

NSP will evaluate the proposals and award the assignment based on technical and financial feasibility. NSP reserves the right to accept or reject any proposal received without giving reasons and is not bound to accept the lowest or the highest bidder.

This post was made using the Auto Blogging Software from WebMagnates.org This line will not appear when posts are made after activating the software to full version.