Approach

Diagnosis before method

We begin by clarifying the decision, target population, treatment effect of interest and available evidence. We then assess feasibility and assumptions before recommending methods that are scientifically credible, transparent and fit for purpose.

The evidence gap

Regulatory trials are designed to demonstrate efficacy, not always to answer the comparative questions that matter for HTA decisions. Differences in population, comparator, endpoint and follow-up create evidence gaps that must be understood before they can be addressed.

Biased or non-credible treatment effect estimates
→
Inability to claim comparative benefit
→
Regulatory or HTA rejection risk
Study dimensionIdeal study for the decisionExample gap in actual study
PopulationTarget decision populationDifferences in effect modifiers
Treatment conditionsAligned comparatorMissing or misaligned comparator
EndpointPatient-relevant outcomeSurrogate or not patient-relevant
Intercurrent eventsApplicable handlingSubsequent therapy not applicable
Summary measureMature, estimableImmature survival

Filling the evidence gap

New treatments are rarely studied in the exact populations and conditions that matter for decision-making. We bridge that gap using the right combination of external evidence and analytical methods, establishing defensible linkages between the sources.

DataActual studies & external evidence
→
MethodsAnalytical approaches
→
AssumptionsEvidence linkage
Comprehensive, decision-relevant evidence
Robust methods for unbiased estimates
Transparent, defensible assumptions

Research framework

  1. Define target populationEstablish who the analysis is designed to inform
  2. Define the causal estimandClarify what treatment effect is being estimated
  3. Define the target trialSpecify the ideal study design for the question
  4. Identify or collect evidenceSystematic search across trial and real-world data
  5. Assess feasibilityEvaluate identifiability given assumptions and available adjustments
  6. Validate clinical assumptions & methodsEnsure the analytical approach is clinically defensible
  7. Define statistical estimandAlign the statistical target with the causal question
  8. Perform analysesExecute with appropriate methods and sensitivity analyses
  9. Communicate resultsClear, credible outputs ready for submission and review

Analytical approaches

Disease-level analyses define baseline risk and outcome relationships, study-level analyses improve internal validity or relevance and extend trial insights, and cross-study analyses enable decision-relevant comparative effectiveness.

Disease-level

  • Natural history analysis
  • Prognostic factor synthesis
  • Biomarker–outcome relationships

Study-level

  • Subgroup analyses
  • Crossover adjustment
  • Extrapolation
  • Population adjustment (transportability)
  • Individual-level surrogacy

Cross-study-level

  • Indirect treatment comparisons (NMA, MAIC, STC)
  • Population-adjusted comparisons (transportability across trials)
  • External control & target trial emulation
  • Trial-level surrogacy & validation

Ready to solve your evidence challenge?

Tell us about your evidence question. Based in Canada, working globally.

founders@unpuzzleheor.ca