Sean Khozin, MD, MPH, on Randomized Trials vs Real-World Evidence in Patients With Advanced Cancer
2022 San Antonio Breast Cancer Symposium
Sean Khozin, MD, MPH, of the Massachusetts Institute of Technology, discusses the “external validity deficits” of randomized clinical trials, which still involve only about 5% of adults with cancer, who may differ in important ways from real-world populations. Dr. Khozin describes the reasons for low levels of participation and advocates for capturing the experience of patients not represented in traditional clinical trials, so real-world data can address these validity deficits.
Transcript
Disclaimer: This video transcript has not been proofread or edited and may contain errors.
We all know clinical trials are the cornerstone of establishing the safety and efficacy of new therapies. [inaudible 00:00:14] authorities rely on clinical trials to make approval decisions, while oncologists depend on the results to guide their treatment decisions at the point of routine care. When we design clinical trials, we ideally aim for studies that have an appropriate balance between internal and external validity. Internal validity refers to the degree to which the results of this study can be correctly attributed to the therapy under investigation. External validity, on the other hand, is important for our ability to generalize the results of this study to patients at the point of care, that is, real-world patient populations. Unfortunately, most cancer clinical trials today have a deficit in external validity, which can make it hard for oncologists to use the results in support of their treatment decisions.
Now, there are several reasons behind external validity deficits in cancer clinical trials. Some of the major contributing factors include differences in protocol-specified procedures and standards of care. The way we treat patients in the context of clinical trials can be very different than how we treat patients in the real world. Cancer clinical trials also have narrow eligibility criteria, for example, excluding patients with poor performance status, comorbidities, and other factors such as brain metastases. In addition, there's significant barriers to clinical trial participation, especially for minorities and patients from disadvantaged socioeconomic backgrounds, for the same reasons that we have uneven access to broader healthcare resources.
The end result of external validity deficits is that the current body of clinical evidence derived from conventional clinical trials may not sufficiently support [personalization 00:02:11] of treatment decisions by oncologists. This is one of the reasons that clinical judgment and anecdotal evidence continue to drive many treatment decisions today, despite our best efforts to develop evidence-based guidelines and recommendations. This not only leads to uneven practice patterns, but can also be contributing factors to disparities in health outcomes.
Now, the three main strategies for addressing external validity deficits that I outlined during my presentation at the San Antonio Breast Cancer Conference. One is the use of real-world data extracted from electronic health records that captured experience and outcomes of patients outside of conventional clinical trials. The second strategy involves decentralization of clinical trials to community health systems and even the patient's homes with, for example, remote monitoring tools and telemedicine technologies. The third strategy is having oncologists adjust the results of conventional clinical trials mathematically to make them more relevant to their patients by accounting for external validity deficits. This can support more precise treatment decisions for patients, especially for minorities and the socio-economically disadvantaged, who I mentioned earlier are typically not adequately represented in conventionally designed clinical studies.
I presented one such mathematical method at the conference, which I developed with my colleague, Roger Stein, at NYU. Since most oncologists don't have training in data science and probability calculus, we translated complex mathematical formulas into visual tools and decision trees that oncologists can easily use to guide their treatment decisions, adjusting the results of conventional clinical trials to fit the profile of their individual patients. Our method can also be used by sponsors of clinical trials to design studies with a more appropriate balance between internal and external validity, which is not only important for addressing health disparities in underserved communities and tailoring treatment decisions at the point of care, but in fact, something that regulators such as the FDA are increasingly looking at in making approval decisions.
Related Videos
The ASCO Post Staff
Sara A. Hurvitz, MD, of the University of California, Los Angeles, Jonsson Comprehensive Cancer Center, discusses phase II results from the TRIO-US B-12 TALENT study, which showed that patients with localized, hormone receptor–positive, HER2-low breast cancer who are treated with fam-trastuzumab deruxtecan-nxki (T-DXd) in the neoadjuvant setting had an overall response rate (ORR) of 68%. When combined with anastrozole, T-DXd led to a 58% ORR. This is the first trial to evaluate T-DXd in HER2-low breast cancer, a potentially curable disease (Abstract GS2-03).
The ASCO Post Staff
Nicholas C. Turner, MD, PhD, of London’s Institute of Cancer Research and The Royal Marsden, discusses phase III results from the CAPItello-291 clinical trial, which showed that in patients with hormone receptor–positive, HER2-negative tumors resistant to aromatase inhibitors, adding the investigational AKT inhibitor capivasertib to fulvestrant doubled the median progression-free survival compared with placebo plus fulvestrant (Abstract GS3-04).
The ASCO Post Staff
Marleen Kok, MD, PhD, of the Netherlands Cancer Institute, discusses the most important advances in early breast cancer treatment during the past year for patients with triple-negative, HER2-positive, and estrogen receptor–positive disease. Dr. Kok also addresses long-term treatment toxicities and quality of life.
The ASCO Post Staff
Lisa A. Carey, MD, and Joannie M. Ivory, MD, MSPH, both of the University of North Carolina at Chapel Hill, discuss the higher frequency and treatment implications of nonluminal A or high-risk tumors in Black and younger women. In this study, PAM50 and 21-gene assays revealed different demographic patterns by race and age (Abstract PD1-08).
The ASCO Post Staff
François-Clément Bidard, MD, PhD, of the Institut Curie, discusses overall survival results from the STIC CTC trial. To guide the choice between chemotherapy and endocrine therapy for patients with metastatic, estrogen receptor–positive/HER2-negative breast cancer, researchers compared circulating tumor cell (CTC) count to physician’s choice of treatment. The data suggest that the CTC count resulted in better long-term outcomes (Abstract GS3-09).
