Posts

Showing posts with the label research

A Short Guide to Determining Sample Size and Statistical Power

Image
S tatistical power depends on factors such as sample size, expected effect, participation, and variation in outcomes. Larger samples and stronger effects increase power, while low participation, unequal group sizes, and cluster randomization can reduce it.  The guide published by  t he Abdul Latif Jameel Poverty Action Lab (J-PAL)  provides  six ‘rules of thumb’ that affect sample size and statistical powe r. In brief ,  this guide   explains that sample size should be determined based on the expected effect, outcome variation, participation, and study design .  Consequently, cluster-based studies usually require a larger total number of participants to achieve the same level of statistical power. Link to the doc:  https://www.povertyactionlab.org/sites/default/files/research-resources/2018.03.21-Rules-of-Thumb-for-Sample-Size-and-Power.pdf Citation:  The Abdul Latif Jameel Poverty Action Lab (J-PAL), 2018.   Six rules of thumb for deter...

Research Is Much More Than Collecting Data

Image
In essence, data collection is part of a researcher’s toolkit, but gathering data alone does not qualify as research.   Hnin Ei Lwin #Monitoring #Evaluation #Reporting #Research #MEARL #social #development #humanitarian #publichealth 

MY APPROACH TO RESEARCH AND M&E: BLENDING QUALITATIVE DEPTH WITH QUANTITATIVE PRECISION

Image
In my research and M&E work, I blend qualitative and quantitative approaches to deeply understand social issues. While I have recently focused on qualitative data for its rich and nuanced insights (which demands strong interpersonal skills throughout collection, analysis, and reporting for reliability and clear communication), I also equally value quantitative data. I believe it is essential for validating findings and continuously sharpening my analytical abilities to better reveal the stories hidden in the numbers. This week, therefore, I want to briefly share my quantitative data analysis toolkit. My Quantitative Data Analysis Toolkit : From Data Collection to Communication I rely on specific tools to effectively collect, analyze, and share data, turning raw information into clear and impactful insights. Excel: This is my go-to for quick data cleaning, sorting, and initial entry, especially for smaller datasets. I use it for early summaries, visualization...

Three Misunderstandings About Research Limitations

Image
Limitations are not something to fear or hide. They are essential for transparent and trustworthy findings.  Over time, I have noticed quite a few misunderstandings when it comes to including limitations in research reports.  This week, I would like to discuss three big ones that I often see: 1. Being reluctant to disclose the limitations. 2. Treating Limitations as a proposal checkbox 3. Discussing limitations at the very end Read the full details in the document below. Next week, I would love to talk about how we can better manage these challenges and properly document limitations in a way that strengthens our reports, not weakens them.   Hnin Ei Lwin #Mon itoring   #Evaluation   #Reporting   #Research   #MEARL #social   #development   #humanitarian   #publichealth   Explore a collection of my content/posts on this website:  https://hnineilwinnotes.blogspot.com

The Art of Balance: In Research and Life

Image
Have you ever thought about the importance of balance in life?  It  is  essential for everything—from the simplest daily routines to the most groundbreaking scientific discoveries and innovations. In research, we apply this principle by using mixed methods whenever possible, combining both quantitative and qualitative approaches for a more comprehensive understanding. Hnin Ei Lwin #Monitoring   #Evaluation   #Reporting   #Research   #MEARL #social   #development   #humanitarian   #publichealth     Explore a collection of my content/posts on this website:  https://hnineilwinnotes.blogspot.com  

Reliability and Validity in Research

Image
Hnin Ei Lwin #Research #monitoring #evaluation #MEARL #Social #development #humanitarian #publichealth

Journey and Destination

Image
In the end, it is not only about what you did, what you delivered, or what your end product is, but also about how you did it and how the process went.  This is what I brought up during the interview yesterday.  Here’s the explanation:  I would like to emphasize the journey, not just the destination, deliverables, or outcomes, and highlight the importance of management, ethics, morale, quality of work, and sustainability. This holistic approach is crucial not only in our professional lives but also in our education, personal development, and even in our relationships.  However, this doesn’t mean the final product is not important. What I mean is that finding a balance between the process and the desired outcome is key, while the final product is undoubtedly important.  On the other hand, I recognize that this idea may not resonate in every setting. Outcome-driven cultures might prioritize results over processes, and evaluating a process-based approach can be cha...

Research Designs

Image
The world of research is filled with diverse tools, and one of the most crucial is research design.  Similar to tools in a toolbox, research designs come in various types, each specifically crafted to address particular research questions.  The exact number of these designs can vary based on their categorization, but here are the major approaches and some of the most common designs within each category. Hnin Ei Lwin #Research #monitoring #evaluation #MEARL  #Social #development #humanitarian #publichealth 

Understanding the Differences: Research vs. Evaluation

Image
RESEARCH VS. EVALUATION While research and evaluation can sometimes overlap, they serve distinct purposes. Let's delve into their key functions. RESEARCH investigates how something works and why things happen. It seeks to expand knowledge or generate new insights or theories about a particular subject. The knowledge can then be applied to broader contexts. EVALUATION determines the worth and significance of something, typically for specific stakeholders. Its primary focus is to assess  the effectiveness  and impact of programs, services, or initiatives. It provides informed decisions, such as feedback and recommendations for future planning, implementation, improvement, and sustainability. Evaluation and social science research, particularly community-based research, often use similar data collection and analysis strategies. They can also complement each other. Research can inform the design of an evaluation, and the findings from the evaluation can guide future research ...

Three Key Research Ethics

Image
Social research goes beyond simply finding answers; it's about doing so ethically. Three key principles underpin ethical research, which are detailed in the image below.   Hnin Ei Lwin #research #MEARL # monitoring #evaluation #accountability #reporting #learning  #social #development #humanitarian #public-health #ethics #consent #confidentiality #non-maleficence

Summer of MSC (Most Significant Change)

Image
MSC, short for Most Significant Change, collects and analyzes personal narratives to grasp impactful positive or negative experiences on individuals or groups.  Employing systematic methods for story collection, selection, and verification, MSC illuminates change processes by considering diverse perspectives and stakeholder values.  This makes it beneficial for a range of evaluations and program theory development, demanding skilled facilitators and transparent selection criteria. See more details below. Hnin Ei Lwin #research #MEARL # monitoring #evaluation #accountability #reporting #learning  #social #development #humanitarian #public-health #most-significant-change #MSC

Applying Goodhart's Law for Effective M&E

Image
Goodhart's Law: 'When a measure becomes a target, it ceases to be a good measure.' Building on Goodhart's Law, here are my key thoughts for M&E: • Focus Beyond Targets : Focusing solely on hitting targets in M&E can lead to neglecting other important aspects. People might prioritize activities that "game the system" rather than achieving true program goals. A broader view is crucial to assess real impact. • The Bigger Picture : Numbers are valuable, but they're just one piece of the puzzle. Qualitative data, such as participant feedback or implementation observations, helps us understand the "why" behind the numbers. Considering context helps M&E accurately assess progress and the program's true impact. • Beyond Measurables : Sometimes, the most important program aspects are hard to quantify. Focusing too much on meeting metrics can distract from the actual impact. For a holistic view, M&E should use both quantitative and qual...