Posts

Showing posts with the label evaluation

Evaluation: A Key Component of Learning and Accountability

Image
Evaluation is a key component of a learning and accountability system, whether in a project, an organization, or our personal lives.  It helps us reflect on what we have done, learn from our experiences, and hold ourselves accountable for how we can improve. Hnin Ei Lwin #Monitoring #Evaluation #Reporting #Research #MEARL #social #development #humanitarian #publichealth    A collection of my Research and MEARL insights is available at:  https://hnineilwinnotes.blogspot.com .

RECONSTRUCTING BASELINE DATA

Image
The lack of baseline data is a recurring challenge in M&E that I have encountered throughout my experience, especially when frameworks require a direct comparison between baseline and endline data to measure changes over time. In practice, there are situations where baseline data are not collected at the beginning of a project, and implementation moves forward based on immediate contextual needs and operational priorities, without fully considering the data requirements outlined in the M&E framework. To address this, I would like to share an old but still useful resource by Michael Bamberger that offers practical strategies for "reconstructing" baseline data. These include using recall methods and key informant interviews to capture early conditions, leveraging secondary sources, reviewing project-specific administrative records, and conducting group interviews to understand past socioeconomic characteristics and behaviors of the target population.  These techniques c...

EVALUATION STRATEGY

Image
Evaluation should be part of an organization's broader learning and accountability system, rather than an ad hoc reporting exercise or merely a requirement for donor compliance. Hnin Ei Lwin #Monitoring #Evaluation #Reporting #Research #MEARL #social #development #humanitarian #publichealth 

Conceptual Framework for Developing Evaluation Capacities

Image
I came across an interesting document online, “Conceptual Framework for Developing Evaluation Capacities,” prepared as an input for a 2010 publication by the International Development Evaluation Association (IDEAS) and the World Bank’s Independent Evaluation Group (IEG). The author presents a framework for strengthening evaluation capacities to support accountability and learning within organizations and at the national level. The framework is built around three core principles of high-quality evaluation: independence, credibility, and utility. To strengthen these qualities, the author suggests a multi-level approach that looks at the individual level (knowledge and ethics), the institutional level (systems and structural safeguards), and the enabling environment (a culture of learning and supportive policies). In short, I find this framework useful. It is conceptually strong but also grounded in real-world practice. I can easily relate it to my own work in promoting evaluatio...

Sen-Robeyns Capability Approach

Image
The Sen-Robeyns Capability Approach  examines  people’s real  freedom and  opportunities to live the kind of life they value, focusing not just on income or happiness, but  also  on well-being, poverty, and justice.  This approach serves as the conceptual foundation for the UNDP’s modern development measures, including the Human Development Index (HDI), the Gender Inequality Index (GII), and the Multidimensional Poverty Index (MPI). O riginally developed by Amartya Sen,  t h is   c apability  a pproach ,  helps us understand what individuals are truly able to do and be. Later, Ingrid Robeyns built on Sen’s ideas, refining the approach for   research on social issues and gender, making it more practical and easier to  use  in real-world studies.   Hnin Ei Lwin #Monitoring #Evaluation #Reporting #Research #MEARL #social #development #humanitarian #publichealth 

The Psychology of Evaluation: From Exam Anxiety to Organizational Learning

Image
Many staff experience evaluations as if they were exams, creating anxiety and often leading organi z ations to focus only on positive results for donors.  Findings are frequently left unused, and challenges are seen as weaknesses rather than opportunities to learn.  By integrating a Utilization-Focused Evaluation approach into other relevant methods, evaluations can become practical, actionable, and truly helpful for improving programs, without adding unnecessary burden on staff. Hnin Ei Lwin #Monitoring #Evaluation #Reporting #Research #MEARL #social #development #humanitarian #publichealth 

Impact Evaluation in UN Agency Evaluation Systems, UNEG, 2013

Image
This week, I read a great resource on impact evaluation and wanted to share it because it provides thorough, practical, and easy-to-follow guidance.  Although developed over a decade ago, the UNEG Impact Evaluation Guidance Note remains highly relevant, outlining core principles such as a strong Theory of Change, mixed-methods approaches, contribution analysis, and quality assurance. It also highlights context-sensitive designs for complex UN programs, which often focus on policy and normative change, including process tracing, qualitative methods, triangulation, and approaches for assessing causal contribution. In short, the document reminds us that impact evaluation is about understanding long-term changes (both expected and unexpected) and exploring how a program contributes to those results. It emphasizes clear causal pathways, evaluability assessments, ethical standards, and robust data collection and analysis.  Overall, it provides a practical framework for conducting cr...

DECOLONISING MEL

Image
I encourage you to read this discussion paper recently published by INTRAC if you work on MEL systems, carry out evaluations, or collaborate with partners in the international development or humanitarian sector. It offers a thoughtful and accessible overview of what decolonising MEL can look like in practice, including centring community knowledge, strengthening local decision making, and using culturally relevant methods. The insights draw on contributions from practitioners and researchers across the global majority and minority worlds, which makes the paper feel grounded and relatable. It is a valuable resource for anyone who wants to approach MEL in a more equitable, reflective, and community-aligned way. Link to the report: https://www.intrac.org/resources/how-are-others-thinking-about-decolonising-mel-within-the-international-development-sector Hnin Ei Lwin #Monitoring #Evaluation #Reporting #Research #MEARL #social #development #humanitarian #publichealth

The Rigor–Relevance Nexus: Bridging M&E and Thematic Knowledge

Image
Many assume that knowing either a thematic area or M&E alone is enough to evaluate a program. In reality, each skill alone is not enough: M&E without sector knowledge can produce technically correct but irrelevant results, while thematic expertise without evaluation skills leaves important insights unmeasured. For a deeper look at why combining M&E and thematic knowledge is essential for meaningful and actionable impact, please read the full document I discuss briefly below. Hnin Ei Lwin #Monitoring #Evaluation #Reporting #Research #MEARL #social #development #humanitarian #publichealth   

UNESCO Evaluation Policy 2022 - 2029

Image
"Evaluations are an integral part of the program planning cycle.  At UNESCO, e valuation serves for  three  main purposes: Learning, Accountability and Decision-Making   ( UNESCO Evaluation Policy 2022 - 2029 )."   Th is   document   sets  out how UNESCO measures and learns from its own work. At its   core , the policy treats evaluation as much more than a technical exercise: it  is   a way to stay accountable, keep learning, and make better decisions based on evidence.   Moreover, i t   places   strong emphasis on values   such as   independence, impartiality, transparency, inclusion, gender equality, human rights ,   and environmental sustainability. This policy   not only   mirrors international best practic e but also   follows the United Nations Evaluation Group (UNEG) standard s, ensuring   UNESCO’s approach is consistent with the wider UN family. It links evaluation directly t...

NARRATIVE ASSESSMENT: BRINGING ADVOCACY STORIES TO LIFE

Image
Th is  Narrative Assessment Manual, produced by Wageningen University & Research and Hivos in 2021, introduces a fresh way to measure and understand advocacy work by transforming real-life experiences into powerful stories.  Advocacy is not a straight line . It  is often a messy, long-term journey filled with challenges that standard reports  simply  cannot capture. Narrative Assessment helps organizations and donors see the real people behind the work, including the struggles, the victories, and the true meaning of every achievement. Remember that Narrative Assessment is a complement, but not a replacement. It is not  designed  to replace other tools like Most Significant Change  or  Outcome Harvesting. Instead, it adds depth,  shedding light  on the hidden dynamics and complex realities of advocacy work that often  go unspoken. So, what does Narrative Assessment look like, in brief? An advocate sits down with a skilled fa...

EVALUATION HANDBOOK - 2024 (EU Publications)

Image
The primary audience for this evaluation handbook includes: Evaluation managers in European Union (EU) delegations and at headquarters, Monitoring and evaluation focal points in EU delegations, and  External evaluation teams and contractors It builds upon the Better Regulation Guidelines (European Commission (EC), 2021a) and the Better Regulation Toolbox (EC, 2023), along with other pertinent EC guidance such as the Results-Oriented Monitoring (ROM) Guidelines, the Evaluation ToR templates and guidance, and various methodological notes issued by the Directorate-General for International Partnerships (DG INTPA) and the Service for Foreign Policy Instruments (FPI). Furthermore, the handbook integrates information from external (non-EC) sources, all of which are fully referenced and/or hyperlinked within the document for further reading. Evaluation Handbook:  https://op.europa.eu/en/publication-detail/-/publication/06350947-4d56-11ef-acbc-01aa75ed71a1/language-en# ISBN 978-92-68-...

Strengthening Data Validity in Social Research and M&E: Comprehensive Overview

Image
This week, I have shared a comprehensive review and key insights on data validity in research, and in the monitoring and evaluation of social projects and programs.  Neglecting data validity, along with the necessary investment of time and resources, can result in unreliable findings. A lack of proper knowledge in this area may have significant negative impacts on research and M&E results, as well as on project and program outcomes. Hnin Ei Lwin #Monitoring   #Evaluation   #Reporting   #Research   #MEARL #social   #development   #humanitarian   #publichealth     Explore a collection of my content/posts on this website:  https://hnineilwinnotes.blogspot.com

The M&E of Self: A Framework for Personal Resilience

Image
Ever wondered how to apply M&E principles to lead a more fulfilling and resilient life? Discover how below. Hnin Ei Lwin hashtag # Research hashtag # Monitoring hashtag # Evaluation hashtag # Reporting hashtag # MEARL hashtag # social hashtag # development hashtag # humanitarian hashtag # publichealth