Week Note 2016 - 19

Week of: 

October 10, 2016

Yes, no, maybe?

 

Two weeks ago, the FDA provided an accelerated approval to a drug for Duchenne muscular dystrophy (DMD) called Exondys 51 (eteplirsen). With each passing week, we see a new issue with the clinical trials system that divides the public and stakeholders. While the CEO of Sarepta said it took “courage” for the FDA to provide this accelerated approval, the approval was not without controversy, with Rob Califf penning a very frank open letter on all the considerations that needed to be undertaken before approval. An important piece of the approval was the support of patient advocacy groups, who have not only funded research on DMD, but have also helped by making the voices of patients heard both through formal and informal channels.

 

Our group, of course, dove right into the issue. Keeping with the onion metaphor, every time we peeled back a layer thinking we had uncovered the answer, we kept finding more information, generating more questions (please see our infographic). For example, the media outlets are simply reporting on the pivotal study involving 12 patients, yet our analysis uncovered at least 48 boys who participated in at least two more trials in addition to the pivotal study. We have also found that most critics are treating this accelerated approval like a regular approval based on just 12 patients. However, this is in no way like a regular approval. The FDA expects studies to still be conducted; two trials are still ongoing, one with an accrual target of 160 patients. Based on the results of those trials, the FDA may choose to withdraw approval.

 

Our team’s insight from reviewing Exondys 51’s approval returns us to a topic we’ve discussed before: human beings are complex, and healthcare needs to acknowledge this complexity when dealing with disease. Currently, the clinical trials process is a linear process, and often fails to capture this complexity. Drug efficacy is often measured as binary: either the drug works or it doesn’t. In the case of DMD, taking the drug either enabled the boys to produce significantly more dystrophin —  the protein that is missing in the disease — than normal or not. In reality, the real question is not simply whether or not the boys produced more dystrophin, but rather how much dystrophin they produced, whether the amount produced was significantly more than normal levels in boys with DMD, and whether that amount translated to a clinical impact on muscular dystrophy symptoms.

 

In fact measuring efficacy is far more complicated and part of the reason why this drug caused internal strife among key FDA personnel. In the pivotal trial, the boys who took Exondys 51 experienced an increase of only 0.28% of normal levels, but that seemingly small increase was, on average, a tripling of normal dystrophin levels for this group. However, based on results from studies of other forms of MD, FDA reviewers felt the children needed to experience an increase of over 10 percent above normal to experience improved DMD symptoms. Obviously, the question is whether DMD should be measured like other forms of MD. There are now at least 30 identified forms of MD that share only one common characteristic, muscle weakness that increases over time; but, the order in which symptoms occur and which parts of the body are affected are different for each form of MD. For diseases like DMD, a binary endpoint is not helpful, and characterizing the percent increase of dystrophin that signals success is incredibly complicated. Science has not caught up with this disease, and there is no other option for treatment. In this case (and perhaps others like it), the mechanism for measuring success (trial endpoints) must be measured differently.

 

Not only us, but a number of other researchers have said that the mechanism for measuring treatment success needs to be more nuanced. Andrew Lo, from the MIT Sloan School of Management, has proposed a mechanism for changing the approval process so that characteristics of the disease such as severity and patient population impacted are taken into account. Others have talked about conditional approval, and trying to get treatments to patients quicker instead of subjecting them to traditional methods. Hence, our team strongly feels that rating efficacy in a binary way does not represent the complexity of disease/ treatment interface. We need ways around it.

 

And in fact, this accelerated approval from the FDA did take into account the complexity! It represents the fact that this is a rare disease, so high recruitment is not possible. It took into account the comments from patients. It specifically ventured into the grey area, and did it in a manner it felt was safe. Yet, it is has been hard for many stakeholders and members of society to acknowledge that. And this, more than anything, is a cultural issue that plagues healthcare. As Atul Guwande would say, we need to think about our lives more holistically, and think about what outcomes we want in our treatments. The drug approval process, an important part of healthcare, should take this into account as well.

 

 

Week Notes Authors

Johns Hopkins University Co-Research Lead

Co-Research Lead

Jen Bernstein has 15 years experience working on WHO-, industry-, U.S. government-funded research studies and clinical trials.  She received her Master of Public Health at the Johns Hopkins Bloomberg School of Public Health and currently works as Part-Time Faculty in the Johns Hopkins Whiting School of Engineering. Jen is also a clinical research associate and independent research consultant providing research support for deliverables at all stages of project development including IRB submissions, journal articles, presentations, and grant submissions. Jen honed her skills at a variety of institutions including The Urban Institute, the Johns Hopkins Center for Communication Programs, and The Weinberg Center for Women's Health and Medicine at Mercy Medical Center. 

MIT Collaborative Initiatives

Ellie Carlough is currently Associate Director of MIT Collaborative Initiatives (MIT-CI) and has been with the organization since September 2007.  In this role, she is actively involved in project management, writing and strategic planning for MIT-CI, which applies a system-based approach to addressing widespread societal issues reaching a crisis point.

Ellie graduated from Mount Holyoke College and earned a Masters of Science in Non-profit Management from the New School for Social Research in New York, New York.  After working in Manhattan for 10 years in banking and most recently as Director of Corporate and Foundation Relations at St. Vincent’s Hospital and Medical Center of New York, Ms. Carlough spent a time in the challenging position of full-time mother mastering the art of multi-tasking and social networking before joining MIT-CI.

SITRA, MIT Collaborative Initiatives

Based in Boston, Justin is the Finnish Innovation Fund's (Sitra) academic liaison for North America and serves as Sitra's Senior Lead for Sustainable Development. He helped design and build the Low2No urban decarbonization initiative and manage its implementation, and served as Helsinki Design Lab's expert on energy, carbon and sustainability. 

Currently he is helping Sitra better align its endowment with its mission by developing ways to place capital in businesses, projects and funds that generate measurable social and environmental impact together with financial return. As part of Sitra’s Strategic Research team, he works to support and challenge Sitra's strategy and shared assumptions. His research includes developing a more comprehensive understanding of sustainable well-being and how Nordic countries can transition toward it with practical economic and public policy measures.

Justin is also an Adjunct Professor at the Rhode Island School of Design where he teaches graduate level design courses. He holds a Master of Architecture degree from the Harvard Graduate School of Design and a Bachelor of Arts from the University of Washington. Find him @justinwcook.

Johns Hopkins University

Viva Dadwal is a Visiting Scholar at Johns Hopkins University Bloomberg School of Public Health, where she is investigating the transfer of health innovations from low to high-income countries. She is a published academic, a Senior Fellow at the Centre on Governance at the University of Ottawa and a Deputy Editor of open-access global health journal, Globalization and Health. Previously, she worked as a Trade Policy Officer for Foreign Affairs, Trade and Development Canada. Viva has held prestigious internships at the World Health Organization and Permanent Mission of Canada to the United Nations and to the World Trade Organization in Geneva, Switzerland.

In her spare time, Viva promotes public astronomy in urban cities through a project called #popscope. She also guest blogs for World Bank’s youth blog, Youthink! Viva holds a B.Sc. (Hons) in Biology from the University of Windsor and an M.A. in Public and International Affairs from the University of Ottawa. Viva is a recipient of Fulbright Canada Award 2014-2015 and a member of the World Economic Forum Global Shapers community. Follow Viva's adventures on Twitter @vivadadwal.

Johns Hopkins University

Francisco Del Canto Viterale is Postdoctoral Researcher in the Systems Institute within the Whiting School of Engineering at Johns Hopkins University. Currently, he is working on two different research projects: “Complex International Innovation Partnerships”, and “Clinical Trials Systems”.

His core area of expertise is the intersection of Science Technology Innovation and Higher Education, and International Relations.

Francisco has been working in the academia for over seventeen years in several countries. He has an extensive experience working as a university lecturer in International Studies, International Migration and Latin American Studies; and also as a researcher in topics related to International Scientific Relations, Science and Innovation Policy and Interdisciplinary, Complex and Systems Approach.

He received his Ph.D. in International and Intercultural Studies from the University of Deusto (Spain) in January 2014. Prior to his doctorate, he earned a Bachelor of Science in International Relations (1998), a Diplomat in International Affairs and Diplomacy (1999) in Argentina, and a Masters in International Migrations and Social Cohesion (2011) in Spain.

Johns Hopkins University

Felipe Feijoo is a Postdoctoral researcher at the Systems Institute in the Whiting School of Engineering, The Johns Hopkins University.

He obtained his B.S. in Engineering Sciences at the Universidad de La Frontera, Chile. Thereafter, he pursued his Master degree (2011) and Ph.D. (2015) in Industrial Engineering at the University of South Florida, Tampa.  

His current research involves the application of stochastic complementarity models and economics to analyze the opening of clinical trials and the pharmaceutical market in the U.S. 

His research also focuses on the application of mathematical programming, game theory, and statistics for decision making in sustainable electricity markets. He worked on a mathematical-statistical framework to developed Pareto designs of cap-and-trade carbon policies with high penetration of green energy via micro-grids. Other research interests include health-economics and predicting-forecast modeling using machine learning techniques. Felipe has also worked and led several projects for the Tampa Electric Company (TECO), Florida.

Johns Hopkins University

Senior Advisor

Dr. Tak Igusa is a professor at the Johns Hopkins University who has been engaged in multi-disciplinary collaborations spanning a wide range of fields.  He currently holds appointments in the Departments of Civil Engineering, International Health, Earth and Planetary Sciences, and Applied Mathematics & Statistics.  To provide rigor to his collaborative activities, Dr. Igusa has been promoting systems science and methodologies, which has led to significant, new research programs within the university.  This includes projects funded by the NIH, Robert Wood Johnson Foundation, CDC and the National Science Foundation on systemic studies of childhood obesity, rheumatic disease, community resilience to natural disasters, and technology innovation in developing nations.  His work led to the establishment of the Johns Hopkins Systems Institute in 2011.

Dr. Igusa received an A.B. in Applied Mathematics from Harvard University and a PhD in Civil Engineering from University of California, Berkeley. At Johns Hopkins, he is currently the Director for Health of the Systems Institute and the Program Lead of the Education & Training Program at the Global Obesity Prevention Center.  He is also advising the development of systems research programs that bridge public health and engineering at the University of the Witwatersrand in Johannesburg, South Africa. 

 

Johns Hopkins University

Gary Lin is currently working on complex systems research with the Johns Hopkins Systems Institute and pursuing a Doctor of Philosophy in Civil Engineering at the Johns Hopkins University.  He has a variety of research interests which includes healthcare systems, infrastructure systems, supply chain and transportation networks, and human population dynamics.  Using his diverse background, Gary has been involved in numerous interdisciplinary projects that range from natural gas networks to environmental impacts of population growth.  He hopes to apply the systems approach towards large-scale, health and engineering issues that face present and future society.

Gary obtained his Bachelor of Science in Civil Engineering and Bachelor of Arts in Economics from the University of Colorado at Boulder.  He is also a registered Engineer-in-Training (EIT) in the state of Colorado and student member of the American Society of Civil Engineers.  In addition, Gary has experience working in food transportation logistics, financial administration, and construction marketing.  Gary enjoys disc golfing, cycling, and hiking in his spare time.

Johns Hopkins University

Paul Locke, an environmental health scientist and attorney, is an Associate Professor at the Johns Hopkins Bloomberg School of Public Health in the Department of Environmental Health Sciences.  He holds a joint appointment in the Department of Health Policy and Management.  Dr. Locke is also the Distinguished Visiting Professor of Animal Law and Science at the Northwestern School of Law of Lewis & Clark College.   Dr. Locke has an MPH from Yale University School of Medicine, a DrPH from the Johns Hopkins University Bloomberg School of Public Health and a JD degree from Vanderbilt University School of Law. 

At Hopkins, Dr. Locke leads an integrated public health research, practice and teaching program.  His program focuses on research-to-practice initiatives to better protect public health, especially in advancing evidence-based in vitro toxicology and radiation protection policy at federal and international organizations.  He has published widely in both law reviews and scientific and policy journals, and has developed three cross-disciplinary courses in environmental law and policy and animal law.  Dr. Locke also directs the School’s Doctor of Public Health program in Environmental Health Sciences and a certificate program in Humane Sciences and Toxicology Policy.

As a member of the clinical trials initiative team, Dr. Locke is helping to better understand the laws, regulations and policies that frame clinical trials and human subjects research, and seeking opportunities to utilize rapidly evolving in vitro toxicological methodologies and other new techniques in clinical trial decision-making.      

Dr. Locke is admitted to practice law in the state of New York and the District of Columbia, the Southern District Court of New York and is a member of the bar of the United States Supreme Court.

Muchieast, Rhode Island School of Design

Systems Innovation Design Lead

Enrique is the systems innovation and design lead for the project. He is the founder and director of Muchieast LLC, an international consultancy working at the intersection of social, cultural and urban contemporary practices by incorporating the principles of systems innovation and creative thinking. He is a Visiting Lecturer at Brown University and a Senior Critic at the Rhode Island School of Design. Enrique holds a Master in Architecture from the Universidad Politécnica de Madrid, Escuela Técnica Superior de Arquitectura de Madrid; and a Master in Industrial Design, with Honors, from the Rhode Island School of Design, where he was granted the Norman Bel Geddes award in 1998.

Johns Hopkins University, Bloomberg School of Public Health

Michele is currently a Senior Research Assistant at Johns Hopkins Bloomberg School of Public Health in the Department of Environmental Health Sciences. Her interests include risk management and communication, effective translation of science into policy, and more recently, using a systems approach to fix ineffective or outdated policy. Since obtaining a Master’s in Health Science and a Certificate in Risk Science and Public Policy in 2012, she has been working on communications with congressional offices on Capitol Hill, conducting legislative analysis, producing advocacy materials and organizing consultation meetings with congressional offices.

Johns Hopkins University Co-Research Lead

Co-Research Lead

Dr. Sauleh Siddiqui is an Assistant Professor of Civil Engineering with an appointment in AppliedMathematics & Statistics at Johns Hopkins University and is affiliated with the Johns Hopkins Systems Institute. He is also a Visiting Researcher and Lecturer at the Technical University of Berlin and the German Economic Research Institute (DIW Berlin). His research is on formulating and solving optimization and game theory models applicable to large-scale systems. Such systems arise when modeling problems in energy and environmental markets, public health, and transportation. He also models engineering design and develops novel algorithms along with supporting mathematical theory.

He has received research funding from the World Bank, Johns Hopkins Health System, the Environment Energy Sustainability Health Institute, and the Norwegian Research Council. In addition, he has collaborated on projects with the International Council on Clean Transportation, Institute of Medicine, National Academy of Engineering, and Bikemore. These projects have included modeling energy and climate markets, patient flow and staffing in hospitals, global vaccination strategies, and urban transport networks.       

He received an A.B. in Mathematics and Public Policy from Franklin & Marshall College and a Ph.D. in Applied Mathematics & Statistics, and Scientific Computation from the University of Maryland, College Park.