Skip to module
Aligned Metrics Initiative

Pre-publication version. PQMD is finalising the text. Layout, navigation and tools are ready for review.

Module 4

Measuring in Partnership

Access to medicines depends on different kinds of expertise coming together and medical product donations operate within a complex ecosystem.

WHY IS MEASURING DONATION IMPACT SO DIFFICULT?

Products move across multiple organizations before reaching patients. Oftentimes measurement conversations do not explicitly happen and organizations end up contributing to the same program while collecting different information for different purposes.

No one organization sees the whole picture. Start with a conversation.

Shared measurement begins by deciding what each partner needs to know, already knows, can contribute as well as discussion about how capacity, cost, burden and interpretation will be shared. These conversations will address the complexity as well as enable informed decisions and shared credible stories.

Shared outcomes require shared measurement decisions.

A shared indicator should not create an unshared burden.

Evidence should travel back through the partnership, not only upward through it.

Partners benefit from discussing expectations early and revisiting them over time.

Useful questions include:

  • What story are we trying to tell?
  • Which impact areas matter most?
  • What data already exists?
  • What data is feasible to collect?
  • Who owns the data?
  • How will the information be used?
  • What level of effort is realistic?

Many measurement challenges can be avoided through early alignment. Check out the AMI tools for partnership alignment on metrics.

Bring the story you defined into the partnership

You have already considered what you are trying to understand or demonstrate, what decision the evidence should support, and where your program may contribute.

What do we already know across this partnership - and what could we understand better together?

Different partners bring different perspectives and needs to measurement

Evidence often sits across organizations rather than in one place. So does its value: organizations often participate in the same donation programs for different reasons. Perspectives will overlap. Shared measurement helps identify alignment and differences.

Partner perspectiveCorporate donor

Evidence, experience and capabilities they may bringProduct and disease-area expertise; product characteristics and appropriate use; supply and forecasting; demand; access strategy; portfolio and partnership context; dating and documentation, fulfilment and dispatch, upstream timelines and corporate strategy

Why this evidence may matterUnderstand whether products are contributing as intended; identify changing demand or gaps; inform product and access strategy; determine where product, coordination, complementary support, systems investment, or another approach may add value; strengthen stewardship and the internal case for social investment

Partner perspectiveNGO / distributor / intermediary / implementer

Evidence, experience and capabilities they may bringTechnical expertise; close knowledge of requests and fulfilment; logistics and product movement; country requirements; partner characteristics and capabilities; direct service-delivery experience; program implementation; geographic reach; operational and contextual realities; service evidence where relevant; cross-program patterns, established relationships

Why this evidence may matterUnderstand how products translate into access and care; identify persistent or seasonal gaps; strengthen implementation and service delivery; improve sourcing, allocation, timing, resource mobilization, and future program design, compare information across partners and products, identify where different support is viable

Partner perspectiveLocal / in-country partner

Evidence, experience and capabilities they may bringPriority demand; receipt and stock status; service availability; patient and provider experience; service and patient data where appropriate; organizational and facility capabilities; operational barriers; community context; local planning needs

Why this evidence may matterMake normalized and/or invisible needs visible; strengthen planning; and communicate local/regional priorities; show what sustained focus enables; identify constraints to care; demonstrate local capacity; shape future support and priorities; engage partners

Partner perspectiveMinistry / public health authority, where relevant

Evidence, experience and capabilities they may bringPublic priorities and supply; policy; facility networks; population and service planning; workforce and infrastructure; health-system capabilities and constraints

Why this evidence may matterUnderstand how external contributions align with public priorities and timelines; identify supply or capacity gaps; inform how external partners can complement national and local systems

Check out AMI’s Tool Guide for Measuring in Partnership This exercise will help partners understand what is realistic together and agree on a meaningful shared measurement approach..

Build from what already exists; starting small

Shared measurement can begin with evidence partners already hold: existing records, periodic observations, sampled reports, and some story capture (qualitative).

Partners likely already hold much of the evidence needed across routine program records, product and supply information, partner reporting, service data, observations, and existing qualitative evidence.

Start there. Measurement practices can strengthen through partnership over time.

A lighter touch approach is honest, useful and preferable to technically ambitious systems that cannot be sustained.

Then ask what is missing. Some additional evidence may be easy to add. Other information may require new access, staff time, technical skills, systems, or budget.

A shared indicator should not create an unshared burden.

If new evidence is needed, the partnership should be clear about who can reasonably provide it, what support is required, and whether the value of the evidence justifies the work involved.

Capacity and budget are part of measurement design

Discuss the resources needed before assigning or assuming responsibility. Capacity includes staff time, systems, data access, technical skills, travel, translation, connectivity, supervision, analysis, and the ability to act on the findings.

QuestionIs this information already collected?

Why it mattersReuse existing evidence before creating a new reporting requirement.

QuestionWhat additional work would be required?

Why it mattersMake staff time and operational burden visible.

QuestionWho has the systems and skills to do the work?

Why it mattersDo not assume the partner closest to the data has the capacity to compile or analyze it.

QuestionWhat will it cost?

Why it mattersMeasurement may require direct budget, not only goodwill.

QuestionWho will fund or support the added work?

Why it mattersShared outcomes should not shift unfunded work downstream.

QuestionWill the evidence be useful to the local partner?

Why it mattersData should support local planning, negotiation, learning, or advocacy as well as upstream reporting.

QuestionCan a lighter approach answer the question?

Why it mattersSampling, periodic observation, or fewer fields may be more proportionate.

Measure contribution, not sole attribution.

One of the most common challenges in donation measurement is attribution. Donated products rarely operate in isolation.

They are used alongside of provider expertise, local resources and procurement, government investments, shared investments, infrastructure and many other factors.

Naming those influences strengthens the story and showcases value while acknowledging the broader systems that absorb donations.

AMI helps organizations showcase their credible role within a broader set of actors, investments, systems, and conditions; not sole attribution.

Evidence should be useful in every direction

The people contributing to the metrics should also gain value from it.

Evidence may help a local partner make an unmet or normalized need visible, strengthen a planning case, demonstrate what sustained support has enabled, or shape what comes next.

For an NGO, it may reveal patterns across products, services, partners, and geographies; strengthen implementation decisions; or make the case for additional capacity and resources.

For a corporate partner, it may strengthen stewardship, product and access strategy, investment decisions, and understanding of where the product contribution is most useful.

Data should be interpreted and shared in the partnership; the meaning of the same finding may hold different value to each partner.

Before you move on

You began with the story you want to understand. You should now have a clearer shared view of:

  • What do we already know together?
  • What is still worth understanding?
  • Who can reasonably contribute the evidence?
  • What capacity or support will that require?
  • How will the evidence be useful across the partnership?
  • What decisions can the evidence unlock for different partners?

Tool 2

Guide for Measuring in Partnership

This exercise will help partners understand what is realistic together and agree on a meaningful shared measurement approach..

If you used Tool 1, bring forward the program purpose. If not, begin here by aligning on shared questions and what decisions data should support. More than one outcome may be relevant. The partnership does not have to measure everything; focus on the outcome question or questions that are useful enough and feasible enough to pursue together

1. Understand the context

For this partnership/program, work with your partners to plot approximately where the program is today. The purpose is to align on the realities of the program and begin conversations about where the program is headed.

DimensionPlot approximately where you are
Product supplyVariable / excessPlanned / predictable
Program RelationshipsNewer /Established /
Partners Involvedmany partnersFewer sustained
Visibility after products are receivedLimited / periodic / sampledRegular / repeated
Existing dataSparse / fragmentedRoutine / aligned
Reporting frequencyperiodiclongitudinal
Staff resources for measurementFew to no dedicated staffDedicated staff and technical support
Budget considerationsNo allocated M&E budgetFull M&E budget
Ability to influence measurement togetherLimitedStrong
Strategic tieExcess product / operationalPurposefully tied to a broader impact strategy

2. Compare perspectives

Understand partner needs and perspectives. Relabel the partner columns as needed. Differences are useful information for designing a workable approach.

QuestionPartner 1Partner 2Partner 3What do we need to align?
Are outputs enough for this program?
How would this evidence be useful for us?
Why does this program tie into a larger impact strategy?
What decision will the evidence inform, and how will it be useful?
What evidence already exists?
What type of data can we realistically access or collect?
Which partners have capacity for which measurement tasks?
What resources may be available?
What support may be required?
What burden would new collection create, if any?

Measurement capacityHave an open discussion about which partners are best positioned for which tasks—standardizing, collecting or accessing data, managing and calculating metrics, gathering qualitative information and stories, interpreting findings, and using or communicating results? Where would support make the work more realistic and who is willing to commit in what timeframe?

Given these conditions, what kind of measurement is realistic for this partnership?

Capacity and budget are part of measurement design

If a measurement approach requires new downstream reporting, partners should discuss the resources needed before assigning responsibility. Capacity includes staff time, systems, data access, technical skills, travel, translation, connectivity, supervision, analysis, and the ability to act on the findings. Budget should be explicit when additional work is being requested.

QuestionIs this information already collected?

Why it mattersReuse existing evidence before creating a new reporting requirement.

QuestionWhat additional work would be required?

Why it mattersMake staff time and operational burden visible.

QuestionWho has the systems and skills to do the work?

Why it mattersDo not assume the partner closest to the data has the capacity to compile or analyze it.

QuestionWhat will it cost?

Why it mattersMeasurement may require direct budget, not only goodwill.

QuestionWho will fund or support the added work?

Why it mattersShared outcomes should not shift unfunded work downstream.

QuestionWill the evidence be useful to the local partner?

Why it mattersData should support local planning, negotiation, learning, or advocacy as well as upstream reporting.

QuestionCan a lighter approach answer the question?

Why it mattersSampling, periodic observation, or fewer fields may be more proportionate.

3. Agree on the approach

We agree on...Decision
Question we are trying to answer
AMI impact area / priority indicator
Existing evidence we will use
Additional evidence genuinely needed
Who provides what
Who compiles / calculates
Who adds qualitative context
Who interprets the findings
Reporting period / frequency
Capacity or technical support needed
Budget required and who covers it
How local partners will use the findings
How findings will be returned / shared
When we will revisit the approach

These next steps can be developed incrementally. Start with what the program and partnership can support now, identify where you’d like to ultimately end up and strengthen it as the evidence, relationships, and capacity develop.

PQMD Aligned Metrics Initiative

Print

What would you like to print?

Pages print in full colour, exactly as they appear here.

Choose what to print