Skill Guide

Outcome measurement using patient-reported outcome measures (PROMs) and engagement metrics

Outcome measurement using PROMs and engagement metrics is the systematic collection and analysis of health status data directly from patients, combined with metrics on their interaction with treatment or digital health interventions, to evaluate clinical and commercial effectiveness.

This skill is highly valued as it provides direct evidence of therapeutic value, enabling data-driven decisions for drug development, value-based pricing, and market access. It directly impacts business outcomes by securing payer reimbursement, improving patient adherence, and demonstrating real-world effectiveness to stakeholders.

1 Careers

1 Categories

9.1 Avg Demand

15% Avg AI Risk

How to Learn Outcome measurement using patient-reported outcome measures (PROMs) and engagement metrics

Focus on 1) Understanding core PROM types (e.g., EQ-5D for general health, SF-36, disease-specific instruments like PHQ-9 for depression), 2) Learning the basics of psychometric properties (reliability, validity, responsiveness), and 3) Grasping key engagement metrics (e.g., session completion rate, daily active users, time-in-app).

Move to practice by learning how to design a data collection protocol, selecting appropriate PROMs for a specific clinical trial or digital therapeutic (DTx), and avoiding common mistakes like choosing an unvalidated instrument or failing to define a minimal clinically important difference (MCID). Analyze real-world case studies of successful PROM integration in FDA submissions.

Master the skill by developing strategies for integrating multi-modal data (PROMs + engagement + biometric data), aligning measurement strategy with HTA (Health Technology Assessment) body requirements, and building a real-world evidence (RWE) generation framework. Mentor others on interpreting complex statistical outputs like mixed-model repeated measures (MMRM) for longitudinal PROM data.

Practice Projects

Beginner

Case Study/Exercise

Selecting the Right PROM for a Digital Therapeutic

Scenario

You are tasked with choosing a primary outcome measure for a prescription digital therapeutic (PDT) targeting generalized anxiety disorder (GAD) for a pivotal clinical trial.

How to Execute

1. Identify and list at least three candidate PROMs for GAD (e.g., GAD-7, HAM-A, PHQ-9). 2. Create a comparison matrix evaluating each on: psychometric validation, patient burden, regulatory precedent, and alignment with the intervention's mode of action. 3. Draft a one-page recommendation memo justifying your selection, citing specific studies or guidance documents.

Intermediate

Project

Building a PROMs & Engagement Dashboard

Scenario

You need to create a live monitoring dashboard for a behavioral health app's ongoing pilot study, combining PROM scores with user engagement data to identify at-risk participants and intervention adherence issues.

How to Execute

1. Define the key metrics: primary PROM (e.g., PHQ-9 score change from baseline), secondary engagement metrics (e.g., ≥3 logins/week, lesson completion rate). 2. Use a tool like Tableau or Power BI to connect to the study's database. 3. Design dashboard views showing: a) aggregate trends over time, b) individual patient trajectories, c) correlation analysis between engagement and outcome. 4. Set up automated alerts for when a patient's PHQ-9 score worsens by a predefined threshold.

Advanced

Case Study/Exercise

Designing an Integrated Evidence Generation Plan for Market Access

Scenario

You are the Head of Evidence for a new medical device with a companion app. You must create a strategy to use PROMs and engagement data to satisfy both the FDA and payers (e.g., a major private insurer or NICE).

How to Execute

1. Map the evidence requirements: FDA wants efficacy/safety (RCTs with validated PROMs), payers want value (real-world data, budget impact models). 2. Design a phased study plan: a) A pivotal RCT with a primary PRO endpoint for regulatory approval, b) A post-market registry collecting long-term PROMs and engagement data to model cost-effectiveness. 3. Develop a statistical analysis plan (SAP) that pre-specifies how engagement metrics will be used as a covariate in the analysis of PROM data (e.g., to demonstrate that higher engagement leads to better outcomes). 4. Create a mock payer dossier outline showcasing how the integrated data will be presented to demonstrate improved outcomes and potential cost offsets.

Tools & Frameworks

Mental Models & Methodologies

Patient-Centered Outcomes Research (PCORI) MethodologyFDA PRO Guidance (2009)HEOR (Health Economics and Outcomes Research) FrameworksRE-AIM Framework (Reach, Effectiveness, Adoption, Implementation, Maintenance)

PCORI and FDA guidance provide the gold-standard methodology for selecting and validating PROMs. HEOR frameworks (e.g., cost-utility analysis) are used to translate outcomes into economic value. RE-AIM is crucial for evaluating the public health impact of interventions, especially digital ones where engagement is critical.

Software & Platforms

REDCap (Research Electronic Data Capture)Tableau / Power BIR (lme4, psych packages) / Python (statsmodels, scipy)

REDCap is the industry-standard for secure, compliant clinical data capture, including PROMs. Tableau/Power BI are used for creating interactive dashboards to monitor trial data in real-time. R and Python are essential for advanced statistical analysis of longitudinal PROM data and psychometric validation.

Standards & Instruments

EQ-5D-5LSF-36/SF-12PROMIS (Patient-Reported Outcomes Measurement Information System)

EQ-5D-5L is the global standard for health utility calculations in HTA. SF-36 is a versatile general health status measure. PROMIS provides a flexible, precision-based system of measures across multiple domains, increasingly used in modern trials for its dynamic properties.

Interview Questions

Answer Strategy

Use a structured approach separating regulatory from commercial interpretation. For the label, focus on the clinical evidence: the PRO result alone may suffice for an indication based on symptom improvement. For the payer dossier, this is a critical gap. Recommend framing the narrative around the drug's standalone efficacy, while acknowledging the app's neutral role. Suggest a post-marketing study to refine the digital intervention and improve engagement to potentially demonstrate additional value (e.g., adherence, real-world cost savings) later.

Answer Strategy

This tests communication and the ability to translate technical concepts into business impact. The answer should define MCID simply, provide a concrete example, and link it to a business outcome like marketing claims or positioning.