Start of story

Demonstrating the benefit of digital health: Challenges and solutions in evidence generation

Digital health solutions are rapidly growing and have the potential to revolutionize healthcare. A rising number of companies and increasing investment in digital health have marked the past decade. 1,2



Start of story

Demonstrating the benefit of digital health: Challenges and solutions in evidence generation

Digital health solutions are rapidly growing and have the potential to revolutionize healthcare. A rising number of companies and increasing investment in digital health have marked the past decade. 1,2

Why is evidence generation important in digital health?

There has been an explosion of digital products in healthcare which are not backed by any rigorous analysis of their safety, efficacy and value to patients or health systems. Digital health companies should be able to demonstrate the benefit of their solutions to ensure they deliver promised advantages to patients, clinicians and health systems. There are two broad areas of evidence — evidence of safety and efficacy, and evidence of value. The four areas assessed for value are clinical, financial, operational and experience.

Icon: Quotation marks (blue)

Digital health solutions have changed how we operate and deliver value, mainly because there are more efficiencies gained from being faster.

Dr. Nam Tran at University of California

Featured customer success stories


Reducing laboratory errors in the pre-pre-analytical phase

Read more


Harnessing analytics for core lab to drive continuous improvement

Read more


Transforming analytics, streamlining laboratory efficiency

Read more

Users seeing success with navify digital health solutions

Evidence generation: Drugs vs. digital health solutions

Challenges of generating evidence

Methodological challenges

Traditional research methodologies, such as randomized clinical trials (RCTs), are ill-suited to digital health solutions. RCTs require large amounts of time, money and resources, while strict inclusion criteria for who can participate may not reflect the diversity of people targeted to use new technology. In addition, the rapid cycle of software solution updates requires similarly dynamic evidence generation.3

Financial cost

Evidence generation can be very expensive. In most markets, reimbursement pathways that reward good evidence do not exist, so manufacturers often have too little incentive to make this investment. However, slowdowns in digital health funding mean investors look for more from innovators, including stronger evidence to demonstrate clinical benefits, indicating ROI for economic buyers.3

Lack of knowledge

Innovators do not know what types of evidence they should pursue. In many cases, there is a lack of clear information on evidence requirements from gatekeepers such as regulators and payors.3

Digital health literacy

Poor digital health literacy among patients and healthcare professionals is a significant hurdle to improved evidence generation and the wider adoption of digital health solutions.3

Data availability

Innovators often don’t have access to data that would help generate strong evidence for their solutions nor the capacity to gather and store it securely. Poor interoperability, siloed data architectures and incoherent data policy between regions all limit progress in this area.3

Get our white paper on evidence generation for digital health solutions

Digital health solution evaluation

Watch keynote speaker Dr. Simon Mathews, assistant professor of medicine at Johns Hopkins Medicine and thought leader for improving care delivery and value through technology, explain this topic.

Methodology options

Simulation studies

Simulation studies ​​evaluate new digital health solutions safely, efficiently and cost-effectively before introducing them to the real world.3

Real-world evidence

Real-world evidence (RWE) adds value in early evaluation and after introduction to the market. Germany’s Fast Track process for digital health solutions highlights the growing importance of RWE in supporting disease diagnosis and treatment as well as patient-initiated lifestyle changes.3

Platform trials

Platform trials are a novel study type designed to be adaptive, thus useful for evolving digital health solutions. They allow interventions to be modified or changed completely over time.4

FAQ

Drive efficiencies, raise health equity, enable value based care

A wide variety of technologies — medical apps, clinical decision support software, electronic health records, telehealth, health information technology, wearables devices, artificial intelligence and machine learning — can be considered digital health solutions. These solutions have the potential to improve health access, outcomes and equity as well as operational efficiency and costs for healthcare organizations.5

There is huge diversity among digital tools. It is critical that evidence requirements are stratified based on intended purpose. Several countries have made progress in establishing evidence standards that take this into account. Generally, clinical evidence of safety, risk assessment, technical documentation and security and data standards are necessary for regulatory approval. But it is crucial that all stakeholders in the digital health field work together with policymakers and regulators to ensure the level of evidence expected for different types of solutions in regulation is robust and sensible.3

 

Software is fundamentally different from drugs and simple medical devices, and treating it in the same way as those interventions is a suboptimal approach. Most types of evidence can be generated at various stages of the product life cycle. Innovators must understand how to iterate rapidly in the early stages and make adaptations before moving forward with a more defined product, requiring more rigorous assessment. It remains a challenge to generate robust evidence for many digital health solutions in a timely and cost-effective manner.

In many markets, the routes to reimbursement for digital solutions remain unclear. In most markets, there is no effective and efficient route to national scale for innovators. Industry needs better opportunities with payors, greater awareness among healthcare professionals about digital solutions and guidance aligned with evidentiary standards to drive increased prescription and reimbursement of these tools.3

For a list of reimbursement pathways in four leading markets, please download our PDF.

A digital health solution with a medical purpose such as disease detection, prevention or management qualifies as a medical device. In the US, digital health solutions categorized as Software as a Medical Device must be approved by the Food & Drug Administration to be prescribed or otherwise adopted. In the EU, Medical Device Software is subject to regulation.

 

  1. Cohen, Dorsey, Mathews, Bates and Safavi. (2020). NPJ digital medicine 3, 1-10
  2. Krasniansky, Evans, and Zweig. (2022). Report available at [Accessed Feb 2024]
  3. Generating evidence for digital health solutions, [Accessed Feb 2024]
  4. Aqib A, Lebouché B, Engler K, Schuster T. Feasibility of a Platform Trial Design for the Development of Mobile Health Applications: A Review. Telemedicine and e-Health. 2023 Apr 1;29(4):501-9.
  5. Saira Ghafur, Matthew S. Prime, Closing the evidence gap for digital health solutions, March 15, 2023, https://healthcaretransformers.com/digital-health/current-trends/digital-health-solutions-evidence-generation/ [Healthcare transformers.com, accessed Oct 2024]