Reach vs. Significance – Impact Assessment Guide
For Pillar C: Research Impact (15%), reviewers evaluate case studies based on two distinct but complementary dimensions: Reach and Significance. To achieve a 4* (Outstanding) rating, a submission must demonstrate exceptional performance in both areas.
1. Defining the Dimensions
Impact is not measured by the number of research papers published, but by the tangible benefit achieved beyond academia.
Dimension | Definition | Key Question |
Reach | The breadth or extent of the impact. | Who benefited, and over how large an area or population? |
Significance | The depth or magnitude of the benefit. | How much of a difference did the research actually make to those people? |
2. Visualising Reach and Significance
Reviewers use a “best-fit” approach to locate your impact on this grid. A high score in one dimension cannot fully compensate for a very low score in the other.
- Broad Reach, High Significance (4*): e.g., A new diagnostic tool adopted nationally across Pakistan that reduced infant mortality by 30%.
- Broad Reach, Low Significance (2*): e.g., A public awareness campaign seen by millions, but with no evidence that it changed anyone’s health behaviour.
- Narrow Reach, High Significance (3*/4*): e.g., Research that fundamentally changed the business model and saved 500 jobs at a major national textile manufacturer.
3. How to Evidence Each Dimension
Reviewers look for specific evidence markers to validate your claims of depth and breadth.
Evidencing Reach (The "Who" and "Where")
- Geographic scale: Evidence of adoption at local, regional, national, or international levels.
- Diversity of beneficiaries: Identifying different groups (e.g., government departments, specific industry sectors, marginalised communities).
- Quantitative data: Number of users, hectares of land improved, or percentage of a sector affected.
Evidencing Significance (The "So What?")
- Pre vs. Post Indicators: Showing measurable improvement from a baseline (e.g., “cost reduced from X to Y”).
- Policy Adoption: Evidence that research was the material driver for a specific change in legislation or clinical guidelines.
- Third-party Validation: Testimonials from high-level decision-makers confirming the depth of the research’s value.
4. Strategic Tip for Case Study Writers
Avoid the “Activity Trap”: Do not confuse reach with the scale of your dissemination.
- Activity (Not Impact): “Our report was downloaded 5,000 times.”
- Reach + Significance (True Impact): “Our report was used by the Ministry of Health to redesign the mobile vaccination strategy in 10 districts, resulting in a 15% increase in uptake