Unpacking Religious Freedom: How Do We Know It’s Changing?
Have you ever wondered how we measure something as complex as religious freedom? It’s not as simple as counting votes or currency. Understanding if religious freedom is progressing, especially in regions like the Middle East, requires a thoughtful approach to tracking changes over time that is based on context-sensitive information and thoughtful methodology.
The Big Picture: Annual Report Cards on Religious Freedom
Several organizations track religious freedom, often publishing annual reports. One of the most prominent is the Pew Research Center, which since 2007, has released two key indices:
- The Government Restrictions Index (GRI): This index looks at laws, policies, and practices that might restrict religious freedom.
- The Social Hostilities Index (SHI): This index measures actions taken by private individuals or groups that target specific religious communities.
Interestingly, while Pew reports that government restrictions on religion reached their highest level worldwide in 2022, their data also suggests a positive trend in many countries Middle East and North Africa (MENA) region. Between 2007 and 2022, countries like Algeria, Bahrain, Egypt, Iran, Jordan, Kuwait, Morocco, Mauritania, Oman, Qatar, Saudi Arabia, Tunisia, the United Arab Emirates, and the Western Sahara have shown improvements in both legal and social dimensions of religious freedom, according to the Pew Research Center. (Table 1).
Table 1. Change in Religious Freedom in the MENA between 2007 and 2022
Improved on both legal and social dimensions of religious freedom
Algeria, Bahrain, Egypt, Iran, Jordan, Kuwait, Morocco, Mauritania, Oman, Qatar, Saudi Arabia, Tunisia, the United Arab Emirates, and the Western Sahara |
Improved on either legal or social dimensions of religious freedom
Afghanistan and Libya |
Declined on both legal and social dimensions of religious freedom |
Iraq, Israel, Lebanon, Pakistan, Palestinian Authorities, and Syria |
Source: Pew Research Center
However, these country-level indices, while valuable, only tell part of the story. They may not capture local, “micro-level” changes, like improved religious tolerance among participants in a specific training program. Crucially, they don’t alone reveal the direct causes of social change.
Starting with What’s Already There: Case Studies
Here are some of the different ways researchers can dig deeper into the impact of religious freedom initiatives:
- Case Studies: Before launching new research, it’s wise to review existing case studies and evaluations like the Pew indexes referenced above. You can look at reports from organizations like the CATO Institute, Freedom House, and the US Commission on International Religious Freedom (USCIRF). Also, tapping into underutilized data sources like the World Values Survey (WVS) and the Arab Barometer can provide valuable insights. The Arab Barometer, for instance, has been surveying Arab countries since 2006, asking questions about people’s beliefs, including some questions about religious freedom.
Using these sources and your own understanding of the country, you can measure lasting and sustainable change by looking for concrete, measurable actions across law, practice, safety, social attitudes, media, and institutions. Below is a compact, practical checklist of the signs that show religious freedom initiatives are advancing and can be incorporated into a case study.
- Legal & policy change and implementation— new or reformed laws are necessary but not sufficient.
- Improved enforcement, not just paper laws —cases won under new rules, restored access, penalties for violators and reductions in administrative obstacles, such as permits granted.
- Fewer rights-violating incidents — a drop in documented discrimination, harassment, vandalism, or forced closures of places of worship.
- Better social attitudes and reduced social hostilities — less hate crimes, mob attacks, public harassment.
- Increased access to services and civic life — minority communities’ access to schooling, health, public benefits, political participation, and recognized places of worship.
- Positive shift in public narrative and media — more balanced, pluralistic media coverage.
Zooming In: The Power of Program Evaluation
To truly understand if initiatives are effective and better identify what leads to change, researchers and practitioners turn to program evaluation research. This involves a systematic study to assess if projects, policies, or programs are truly working. Many funders now specifically ask for this kind of evidence.
- Asking Participants Directly Using Qualitative Methods: These methods focus on understanding people’s perceptions and experiences through such tools as:
◦ Semi-structured interviews
◦ Focus groups
Qualitative methods are generally accessible and can provide rich, detailed information about how an intervention has impacted individuals.
- Collecting Quantitative Data: This involves collecting numerical data, typically through surveys.
◦ Conducting surveys
Many evaluation studies, including surveys, ask participants to reflect after a training on what they’ve learned. If possible, measure attitudes both before (pre-test) and after (post-test) a training or program. For example, asking participants “To what extent do you agree or disagree that religious freedom must be ensured?” both before and after a training provides direct, measurable data. By doing so, you can compare participants’ average support for religious freedom before as well as after the training and assess the extent to which it has changed.
- Consider an Experimental Design: It’s also worth knowing about another, more advanced approach which is to incorporate an experimental design into your survey-based evaluation research. An experimental design, is the “gold standard” for testing cause and effect. How does it work?
◦ Random Assignment: Individuals are randomly assigned to one of two groups: a treatment group (who receives the training program) or a control group (who does not receive the intervention at that time). Members of both groups fill out the pre-test and the post-test.
One way to include everyone in the training and still approximate an experimental design is to stagger the administration of the testing.
◦ Staggered Testing: To so this, administer a pre-test to all participants. Then, administer the post-test to the control group before the training. After the training, administer the post-test to the treatment group. This helps you compare changes that specifically occurred due to the program while will letting everyone participate.
Checklist
While the experimental method provides the most convincing results, it’s not always practical or ethical, especially in sensitive contexts. Evaluating the training through a small set of qualitative interviews or focus groups or a short survey after the event is a great first step that will provide valuable information about how your work impacts others.
Why All This Effort Matters
Starting with rich contextual knowledge about how laws and social practices are changing is wise. And rigorous evaluation efforts of your program, even with a few qualitative interviews, are crucial. They help organizations show how their programs and trainings truly shift attitudes, build connections, and create conditions that allow individuals from diverse backgrounds and belief systems to thrive. For those embarking on such evaluations, partnering with social scientists or international organizations can significantly enhance the work. Every layperson, activist, and changemaker can develop a simple, sound strategy to collect, analyze, and share information about the impact of their work. It’s all about moving beyond simply offering programs to truly understanding and demonstrating their profound impact on religious freedom. And when coupled with broader assessments of changes in across law, practice, safety, social attitudes, media, and institutions in a country, it is an effective way to show impact and understand the causes of social change.
Box 1. Program Evaluation Checklist
- Start with what’s already there. Use it to develop case studies.
- Consider research ethics, safety, and practical concerns
- Choose one or more data collection methods: (1) Qualitative interviews or focus groups and/or (2) Surveys
- If using surveys, choose a method: (1) Observational (everyone is part of the treatment group) or (2) Experimental (half of the participants at random are in the treatment group and half are in the control group).
- Prepare the study materials (e.g., questionnaires)
- Implement the study
- Analyze the information
- Share the information through a report or presentations
