According to the project
proposals, the four microfinance projects to be evaluated were contracted to
providing responsible microfinance services to low income and economically
vulnerable people. The MFIs also aim to continue providing microfinance services
to the communities for the long term beyond the project timeframe.
The general purpose of the final evaluation is to
assess the extent to which the MFIs implemented projects have continued
providing financial services beyond the project timeframe, and to discern
overall lessons and best practices. For midterm evaluation, the
purpose is to assess whether microfinance activities are on track in ways that
they are continued as per project proposals beyond contract period.
This is an external evaluation, from
which the findings will not only help LIFT but also support LIFT partners in developing
and implementing more effective responsible microfinance services.
Specific Objectives
of the Evaluation
The objectives of the evaluation
are to:
- Lessons Learned, Good Practices, and Recommendations: Identify
the major lessons and best practices across all five projects in support of
microfinance services, and provide relevant recommendations to microfinance
partners and LIFT, particularly in the areas of supervision, monitoring,
evaluation and learning.
- Efficiency, Effectiveness and Sustainability: Assess the
institutional performance and quality of financial products to what extent they
address the issues of sustainable and responsible financial services.
- Relevance: Appraise the extent to which the
microfinance services are suited to LIFT priorities.
Key
Evaluation Questions
The evaluation is to address key
questions, such as:
- Lessons Learned
and Best Practices
a) What is the status of people excluded by the
microfinance product and service designs (market failure)?
b) What are the issues and problems or challenges in
promoting inclusive financial services[1]?
c) How should microfinance institutions promote
inclusive financial services?
d) What are the relevant lessons learned for the
microfinance market?
e) What are the most effective approaches for
delivering microfinance (best practices)?
- Efficiency,
Effectiveness and Sustainability
f) What are the types of microfinance services offered
by the MFIs?
g) How did the projects deliver their microfinance
services?
h) Were the microfinance services provided by the time
the services are needed?
i) To what extent did the microfinance services, both
in relevance and quality, satisfy the needs of the clients?
j) Do the microfinance approaches sufficiently address
client protection principles[2]
outlined by Financial Regulatory Department?
k) Are the branches operationally sustainable?
l) Are the branches financially sustainable?
m) What are the challenges for institutional
sustainability?
n) What are the strategies for selection of
microfinance clients?
o) How did the microfinance activities meet LIFT’s
policies and objectives?
p) To what extent are the microfinance services and
delivery methods in line with LIFT Financial Inclusion Strategy?
- Evaluation against
the LIFT Financial Inclusion Monitoring and Evaluation Framework
The evaluation will also assess how the organizations have performed
against the LIFT’s Financial Inclusion monitoring, evaluation, accountability
and learning framework (MEAL Framework). The learning questions will be reviewed and
expanded into interview questions during the document review stage, and in
consultation with relevant LIFT FMO and MFI staff. The resulting questionnaire
will be approved by the LIFT Evaluation Supervisor (see the annex 3 for learning questions and more details).
Evaluation
Design and Methodology
The design of the evaluation will be
primarily qualitative in nature, using qualitative data collection methods such
as: (a) document review, (b) key informant interviews, and (c) focus group
discussions.
- Document Review: Project documents to review include
project proposals, work plans, logical frameworks (measurement plan), annual
reports, and other internal reports. Financial statements, such as balance
sheets and income statements reported to LIFT and maintained by the
microfinance branch offices, also should be reviewed in order to analyze
operational performance.
- Key Informant Interviews (KII): KIIs should be used
to investigate management and implementation issues and problems. KIIs should
be conducted with the management personnel of implementing partners such as
project managers, branch managers, loan officers, etc.
- Focus Group Discussions (FGD): FGD is the primary
method for collecting data from microfinance clients and other community
members. The FGDs should be conducted
with a minimum of eight and a maximum of 15 participants, usually with separate
groups for men and women, and conducted at the village level.
A
summary of the recommended research methods is as follows:
Activity
|
Requirements
|
|
IPs/MFIs/Clients
|
Summary
|
Key Informant Interviews
|
At lease, 2 KIIs should be conducted for each MFI (1 with Yangon
level management and another 1 with branch level management including branch
managers and loan officers).
|
MAFIN = 2 KIIs
MARC = 10 KIIs
Gret Dryzone = 2 KIIs
Gret Chin = 2 KIIs
Total KIIs = 16 KIIs
|
Focus Group Discussion (FGD)
|
FGD should be conducted at village level during field visits to
villages of microfinance clients.
|
MAFIN = 3 FGDs
MARC = 9 FGDs
Gret Dryzone = 2 FGDs
Gret Chin = 2 FGDs
Total = 16 FDGs
|
Deliverables and timelines
The selected consultant must submit the
following deliverables. The research should be completed within three and half months with a total of 64
days. Please refer to Annex 2 for a draft work plan.
Deliverables
|
Timeframe*
|
Remark
|
Document
reviews
|
Completed review of project related and MFI documents as
follows.
- Review
of documents for MAFIN, MARC and Gret in week 2.
|
Review
works of Microlead will start after completion of first draft evaluation
reports of MAFIN, MARC and Gret.
See details in work plan.
|
Evaluation
design
|
Completed evaluation
design with questions for KII and FGDs in week 2.
|
Evaluation
design will be same for all projects.
However,
there will be additional questions added for each project after consultation
with implementing partners.
|
Draft
evaluation reports
|
Completed draft evaluation reports as follows.
- Draft
reports for MAFIN, MARC and Gret (in week 11)
|
|
Briefing
session
|
Conducted presentation of findings as follows.
- Briefing
session for MAFIN, MARC and Gret (in week 13)
|
The first
briefing session will be combined for MAFIN, MARC and Gret as experience
sharing and learning among LIFT MFIs (similar to COP).
|
Submit
Final evaluation report
|
Submitted
final reports as follows.
- Final reports for MAFIN, MARC
and Gret (in week 15)
|
Program
Officer (Rural Finance and Value Chains) will approve the reports.
Gret has
secured one microfinance license for both Dryzone and Chin. Therefore, report for Gret Dryzone and Chin
will be combined into one report with separate analysis for Dryzone and Chin.
There will
be four reports in total.
|
* Numbers of weeks since the starting date
Reports:
The evaluation covers four projects,
an individual evaluation report is required for MAFIN, MARC and MicroLead and
Gret (three reports in total)
answering the evaluation questions under paragraph 5. In addition, institutional performance
report of each MFI must be included. The summary of reporting requirement is as
follows.
- MAFIN:
Final evaluation of PGMF’s Dryzone Microfinance business in 6 branches
- MARC:
Final evaluation of microfinance business implemented by 9 local MFIs
- Gret:
Mid-term evaluation of microfinance business implemented by Gret in Dryzone and
Chin
All written reports are to use standard and grammatically
correct English.
Management Arrangement
The LIFT FMO will
support the consultant by:
- Making
sufficient time and resources available for the mission in Yangon and link the
evaluation team with relevant LIFT partners in the field;
- Organizing
the logistics and briefing session (including costs for venue and materials
required, lunch / refreshments, and sending invitations);
- Providing
relevant reports and materials produced by LIFT and LIFT partners;
- Translating
during interviews and focus group discussions (to be translated by
non-project-focal person from LIFT);
- Helping for work plan
development and adjustment; and
- Organizing field
visits.
[1] Inclusive financial
service: financial service accessible by people at different economic levels
and of which terms and conditions are designed according to the demand from
those people
[2] Appropriateness of
product design, policies that prevent over-indebtedness, transparent
transaction and information, responsible pricing, complaint mechanism, etc.