In the midst of epidemics such as COVID-19, therapeutic candidates are unlikely to be able to complete the usual multi-year clinical trial and regulatory approval process within the course of an outbreak. We apply a Bayesian adaptive patient-centered model—which minimizes the expected harm of false positives and false negatives—to optimize the clinical trial development path during such outbreaks. When the epidemic is more infectious and fatal, the Bayesian-optimal sample size in the clinical trial is lower and the optimal statistical significance level is higher. For COVID-19 (assuming a static Ro = 2 and initial infection percentage of 0.1%), the optimal significance level is 7.1% for a clinical trial of a non-vaccine anti-infective therapeutic clinical trial and 13.6% for that of a vaccine. For a dynamic Ro ranging from 2 to 4, the corresponding values are 14.4% and 26.4%, respectively. Our results illustrate the importance of adapting the clinical trial design and the regulatory approval process to the specific parameters and stage of the epidemic.

A key driver in biopharmaceutical investment decisions is the probability of success of a drug development program. We estimate the probabilities of success (PoS) of clinical trials for vaccines and other anti-infective therapeutics using 43,414 unique triplets of clinical trial, drug, and disease between January 1, 2000, and January 7, 2020, yielding 2,544 vaccine programs and 6,829 non-vaccine programs targeting infectious diseases. The overall estimated PoS for an industry-sponsored vaccine program is 39.6%, and 16.3% for an industry-sponsored anti-infective therapeutic. Among industry-sponsored vaccines programs, only 12 out of 27 disease categories have seen at least one approval, with the most successful being against monkeypox (100%), rotavirus (78.7%), and Japanese encephalitis (67.6%). The three infectious diseases with the highest PoS for industry-sponsored nonvaccine therapeutics are smallpox (100%), CMV (31.8%), and onychomycosis (29.8%). Nonindustry- sponsored vaccine and non-vaccine development programs have lower overall PoSs: 6.8% and 8.2%, respectively. Viruses involved in recent outbreaks—MERS, SARS, Ebola, Zika—have had a combined total of only 45 non-vaccine development programs initiated over the past two decades, and no approved therapy to date (Note: our data was obtained just before the COVID-19 outbreak and do not contain information about the programs targeting this disease.) These estimates offer guidance both to biopharma investors as well as to policymakers seeking to identify areas most likely to be undeserved by private-sector engagement and in need of public-sector support.

The healthcare industry in the United States (U.S.) is a complex ecosystem with many different stakeholders. Unlike the universal single-payer healthcare systems of many European countries,the accessibility of prescription drugs in the U.S. is largely determined by contract negotiations between health plans and drug manufacturers about formulary placement. These negotiations can sometimes result in higher out-of-pocket costs for the patient, since the current structure of the U.S. healthcare system creates a perverse incentive for many health plans to elicit higher rebates from drug manufacturers in exchange for formulary placement of brand-name drugs, thereby increasing patients’ out-of-pocket costs.

We extend earlier large-scale studies of clinical trial statistics by focusing on the performance of oncology trials. Using 108,248 data points between January 1, 2005, and September 31, 2018, compiled from the Citeline database, we investigate the duration of clinical trials and compute the probabilities of success of 24,448 oncology drug development programs by disease group. While the overall phase 1 to approval rate for all oncology-related drug development programs is 3.3%, individual disease groups have approval rates ranging from 0% to 10.1%. Similar patterns can be seen for oncology orphan drug development programs, where the overall probability of success ranges from 0% to 8.3%, with an overall average of 1.9%. We find overwhelming evidence that using biomarkers for patient selection is effective in almost all disease groups within oncology, raising the overall probability of success by an average of 13.3%.

Advances in biomedical research have created significant opportunities to bring to market a new generation of therapeutics. However, early-stage assets often face a dearth of funding, as they have a high risk of failure and significant development costs. Historically, this has been particularly true for assets intended to treat rare diseases, where market sizes are often too small to attract much attention and funding. Venture philanthropy (VP) — which, for the purpose of this paper, is defined as a model in which nonprofit, mission-driven organizations fund initiatives to advance their objectives and potentially achieve returns that can be reinvested toward their mission — offers an alternative to traditional funding sources like venture capital or the public markets. Here we highlight the Cystic Fibrosis (CF) Foundation, widely considered to be the leading VP organization in biotech, which facilitated the development of Kalydeco, the first disease-modifying therapy approved to treat cystic fibrosis. We evaluate the CF Foundation’s example, including its agreement structures and strategy, explore the challenges that other nonprofits may have in adopting this strategy, and draw lessons from the CF Foundation for other applications of VP financing.

The prediction of clinical outcomes for patients with cancer is central to precision medicine and the design of clinical trials. We developed and validated machine-learning models for three important clinical end points in patients with advanced non–small-cell lung cancer (NSCLC)—objective response (OR), progression free survival (PFS), and overall survival (OS)—using routinely collected patient and disease variables. We aggregated patient-level data from 17 randomized clinical trials recently submitted to the US Food and Drug Administration evaluating molecularly targeted therapy and immunotherapy in patients with advanced NSCLC. To our knowledge, this is one of the largest studies of NSCLC to consider biomarker and inhibitor therapy as candidate predictive variables. We developed a stochastic tumor growth model to predict tumor response and explored the performance of a range of machine-learning algorithms and survival models. Models were evaluated on out-of-sample data using the standard area under the receiver operating characteristic curve and concordance index (C-index) performance metrics. Our models achieved promising out-of-sample predictive performances of 0.79 area under the receiver operating characteristic curve (95% CI, 0.77 to 0.81), 0.67 C-index (95% CI, 0.66 to 0.69), and 0.73 C-index (95% CI, 0.72 to 0.74) for OR, PFS, and OS, respectively. The calibration plots for PFS and OS suggested good agreement between actual and predicted survival probabilities. In addition, the Kaplan-Meier survival curves showed that the difference in survival between the low- and high-risk groups was significant (log-rank test P, .001) for both PFS and OS. Biomarker status was the strongest predictor of OR, PFS, and OS in patients with advanced NSCLC treated with immune checkpoint inhibitors and targeted therapies. However, single biomarkers have limited predictive value, especially for programmed death-ligand 1 immunotherapy. To advance beyond the results achieved in this study, more comprehensive data on composite multiomic signatures is required.

Researchers, clinicians, policymakers and patients are increasingly interested in questions about therapeutic interventions that are difficult or costly to answer with traditional, free-standing, parallel-group randomized controlled trials (RCTs). Examples include scenarios in which there is a desire to compare multiple interventions, to generate separate effect estimates across subgroups of patients with distinct but related conditions or clinical features, or to minimize downtime between trials. In response, researchers have proposed new RCT designs such as adaptive platform trials (APTs), which are able to study multiple interventions in a disease or condition in a perpetual manner, with interventions entering and leaving the platform on the basis of a predefined decision algorithm. APTs offer innovations that could reshape clinical trials, and several APTs are now funded in various disease areas. With the aim of facilitating the use of APTs, here we review common features and issues that arise with such trials, and offer recommendations to promote best practices in their design, conduct, oversight and reporting.

Billions of dollars are spent annually on cancer drug development, yet effective treatments for many types of cancer remain as elusive as ever. Recently, the MIT Laboratory for Financial Engineering announced the launch of Project ALPHA (Analytics for Life-sciences Professionals and Healthcare Advocates), a large-scale estimation of clinical trial probabilities of success (PoS) for a variety of drug development programs, where a single program is defined as the set of all clinical trials corresponding to a unique drug-indication pair. In that study, we found that only 3.4 percent of all cancer drug development programs from 2000 to 2015 moved from phase 1 to regulatory approval, despite the fact that oncology accounted for 42 percent of all drug development programs in that dataset.

Congressional testimony prepared for the U.S. House of Representatives Financial Services Committee Hearing on Examining Private Market Exemptions as a Barrier to IPOs and Retail Investment, held on September 11, 2019.

Professor Lo discusses proposed legislation intended to allow innovative companies to gain greater access to investors who are comfortable with the higher risks (and rewards) of private investments. He highlights the "Rare Disease Fund Act" sponsored by Representatives Juan Vargas (CA-51) and Scott Peters (CA-52), which proposes the development of a "megafund"—created under the full supervision of the SEC—to acquire the development rights to multiple rare disease therapeutic candidates. Such a public-private fund focused on rare diseases could serve as a viable pilot project for further development of the megafund concept. Professor Lo remarks, "With more innovative financial and business structures, and the already existing close partnership between orphan drug developers and government agencies like the National Center for Advancing Translational Sciences, we can make even greater progress in easing the burden of disease for millions of Americans."

Thanks to a combination of scientific advances and economic incentives, the development of therapeutics to treat rare or orphan diseases has grown dramatically in recent years. With the advent of Food and Drug Administration–approved gene therapies and the promise of gene editing, many experts believe we are at an inflection point in dealing with these afflictions. In this article, the authors propose to document this inflection point by measuring the risk and reward of investing in the orphan drug industry. They construct a stock market index of 39 publicly traded companies that specialize in developing drugs for orphan diseases and compare the financial performance of this index, which they call ORF, to the broader biopharmaceutical industry and the overall stock market from 2000 to 2015. Although the authors report that ORF underperformed other biopharma companies and the overall stock market in the early 2000s, its performance has improved over time: from 2010 to 2015, ORF returned 608%, far exceeding the 317%, 320%, and 305% returns of the S&P, NASDAQ, and NYSE ARCA Biotech indexes, respectively, and the 83% of the S&P 500. ORF does have higher volatility than the other indexes but still outperforms even on a risk-adjusted basis, with a Sharpe ratio of 1.24 versus Sharpe ratios of 1.17, 1.14, and 1.05, respectively, for the other three biotech indexes and 0.71 for the S&P 500. However, ORF has a market beta of 1.16, which suggests significant correlation to the aggregate stock market and less diversification benefits than traditional pharmaceutical investments.

We consider a portfolio-based approach to financing ovarian cancer therapeutics in which multiple candidates are funded within a single structure. Twenty-five potential early-stage drug development projects were identified for inclusion in a hypothetical portfolio through interviews with gynecological oncologists and leading experts, a review of ovarian cancer-related trials registered in the ClinicalTrials.gov database, and an extensive literature review. The annualized returns of this portfolio were simulated under a purely private sector structure both with and without partial funding from philanthropic grants, and a public–private partnership that included government guarantees. We find that public–private structures of this type can increase expected returns and reduce tail risk, allowing greater amounts of private sector capital to fund early-stage research and development.

We apply machine-learning techniques to predict drug approvals using drug-development and clinical-trial data from 2003 to 2015 involving several thousand drug-indication pairs with over 140 features across 15 disease groups. To deal with missing data, we use imputation methods that allow us to fully exploit the entire dataset, the largest of its kind. We show that our approach outperforms complete-case analysis, which typically yields biased inferences. We achieve predictive measures of 0.78, and 0.81 AUC (“area under the receiver operating characteristic curve,” the estimated probability that a classifier will rank a positive outcome higher than a negative outcome) for predicting transitions from phase 2 to approval and phase 3 to approval, respectively. Using five-year rolling windows, we document an increasing trend in the predictive power of these models, a consequence of improving data quality and quantity. The most important features for predicting success are trial outcomes, trial status, trial accrual rates, duration, prior approval for another indication, and sponsor track records. We provide estimates of the probability of success for all drugs in the current pipeline.

Rare-disease drug development is both scientifically and commercially challenging. This case study highlights Agilis Biotherapeutics (Agilis), a small private biotechnology company that has developed the most clinically advanced adeno-associated virus (AAV) gene therapy for the brain. In an international collaboration led by Agilis with National Taiwan University (NTU) Hospital and the Therapeutics for Rare and Neglected Diseases (TRND) program of the National Center for Advancing Translational Sciences (NCATS) at the National Institutes of Health, Agilis’ gene therapy for aromatic L-amino acid decarboxylase deficiency (AADC), AGIL-AADC, was granted biologics license application (BLA)-ready status by the FDA in 2018 only 18 months after being licensed from NTU by Agilis. Here, we highlight the factors that have enabled this remarkable pace of successful drug development for an ultra-rare disease.

Previous estimates of drug development success rates rely on relatively small samples from databases curated by the pharmaceutical industry and are subject to potential selection biases. Using a sample of 406,038 entries of clinical trial data for over 21,143 compounds from January 1, 2000 to October 31, 2015, we estimate aggregate clinical trial success rates and durations. We also compute disaggregated estimates across several trial features including disease type, clinical phase, industry or academic sponsor, biomarker presence, lead indication status, and time. In several cases, our results differ significantly in detail from widely cited statistics. For example, oncology has a 3.4% success rate in our sample vs. 5.1% in prior studies. However, after declining to 1.7% in 2012, this rate has improved to 2.5% and 8.3% in 2014 and 2015, respectively. In addition, trials that use biomarkers in patient-selection have higher overall success probabilities than trials without biomarkers.

Implicit in the drug-approval process is a trade-off between Type I and Type II error. We propose using Bayesian decision analysis (BDA) to minimize the expected cost of drug approval, where relative costs are calibrated using U.S. Burden of Disease Study 2010 data. The results for conventional fixed-sample randomized clinical-trial designs suggest that for terminal illnesses with no existing therapies such as pancreatic cancer, the standard threshold of 2.5% is too conservative; the BDA-optimal threshold is 27.9%. However, for relatively less deadly conditions such as prostate cancer, 2.5% may be too risk-tolerant or aggressive; the BDA-optimal threshold is 1.2%. We compute BDA-optimal sizes for 25 of the most lethal diseases and show how a BDA-informed approval process can incorporate all stakeholders’ views in a systematic, transparent, internally consistent, and repeatable manner.