Skip to main content
  • American Heart Association
  • Science Volunteer
  • Warning Signs
  • Advanced Search
  • Donate

  • Home
  • About this Journal
    • Editorial Board
    • Meet the Editors
    • Editorial Manifesto
    • Impact Factor
    • Journal History
    • General Statistics
  • All Issues
  • Subjects
    • All Subjects
    • Arrhythmia and Electrophysiology
    • Basic, Translational, and Clinical Research
    • Critical Care and Resuscitation
    • Epidemiology, Lifestyle, and Prevention
    • Genetics
    • Heart Failure and Cardiac Disease
    • Hypertension
    • Imaging and Diagnostic Testing
    • Intervention, Surgery, Transplantation
    • Quality and Outcomes
    • Stroke
    • Vascular Disease
  • Browse Features
    • Circulation Research Profiles
    • Trainees & Young Investigators
    • Research Around the World
    • News & Views
    • The NHLBI Page
    • Viewpoints
    • Compendia
    • Reviews
    • Recent Review Series
    • Profiles in Cardiovascular Science
    • Leaders in Cardiovascular Science
    • Commentaries on Cutting Edge Science
    • AHA/BCVS Scientific Statements
    • Abstract Supplements
    • Circulation Research Classics
    • In This Issue Archive
    • Anthology of Images
  • Resources
    • Online Submission/Peer Review
    • Why Submit to Circulation Research
    • Instructions for Authors
    • → Article Types
    • → Manuscript Preparation
    • → Submission Tips
    • → Journal Policies
    • Circulation Research Awards
    • Image Gallery
    • Council on Basic Cardiovascular Sciences
    • Customer Service & Ordering Info
    • International Users
  • AHA Journals
    • AHA Journals Home
    • Arteriosclerosis, Thrombosis, and Vascular Biology (ATVB)
    • Circulation
    • → Circ: Arrhythmia and Electrophysiology
    • → Circ: Genomic and Precision Medicine
    • → Circ: Cardiovascular Imaging
    • → Circ: Cardiovascular Interventions
    • → Circ: Cardiovascular Quality & Outcomes
    • → Circ: Heart Failure
    • Circulation Research
    • Hypertension
    • Stroke
    • Journal of the American Heart Association
  • Impact Factor 13.965
  • Facebook
  • Twitter

  • My alerts
  • Sign In
  • Join

  • Advanced search

Header Publisher Menu

  • American Heart Association
  • Science Volunteer
  • Warning Signs
  • Advanced Search
  • Donate

Circulation Research

  • My alerts
  • Sign In
  • Join

  • Impact Factor 13.965
  • Facebook
  • Twitter
  • Home
  • About this Journal
    • Editorial Board
    • Meet the Editors
    • Editorial Manifesto
    • Impact Factor
    • Journal History
    • General Statistics
  • All Issues
  • Subjects
    • All Subjects
    • Arrhythmia and Electrophysiology
    • Basic, Translational, and Clinical Research
    • Critical Care and Resuscitation
    • Epidemiology, Lifestyle, and Prevention
    • Genetics
    • Heart Failure and Cardiac Disease
    • Hypertension
    • Imaging and Diagnostic Testing
    • Intervention, Surgery, Transplantation
    • Quality and Outcomes
    • Stroke
    • Vascular Disease
  • Browse Features
    • Circulation Research Profiles
    • Trainees & Young Investigators
    • Research Around the World
    • News & Views
    • The NHLBI Page
    • Viewpoints
    • Compendia
    • Reviews
    • Recent Review Series
    • Profiles in Cardiovascular Science
    • Leaders in Cardiovascular Science
    • Commentaries on Cutting Edge Science
    • AHA/BCVS Scientific Statements
    • Abstract Supplements
    • Circulation Research Classics
    • In This Issue Archive
    • Anthology of Images
  • Resources
    • Online Submission/Peer Review
    • Why Submit to Circulation Research
    • Instructions for Authors
    • → Article Types
    • → Manuscript Preparation
    • → Submission Tips
    • → Journal Policies
    • Circulation Research Awards
    • Image Gallery
    • Council on Basic Cardiovascular Sciences
    • Customer Service & Ordering Info
    • International Users
  • AHA Journals
    • AHA Journals Home
    • Arteriosclerosis, Thrombosis, and Vascular Biology (ATVB)
    • Circulation
    • → Circ: Arrhythmia and Electrophysiology
    • → Circ: Genomic and Precision Medicine
    • → Circ: Cardiovascular Imaging
    • → Circ: Cardiovascular Interventions
    • → Circ: Cardiovascular Quality & Outcomes
    • → Circ: Heart Failure
    • Circulation Research
    • Hypertension
    • Stroke
    • Journal of the American Heart Association
Perspectives

Personal Reflections on Big Science, Small Science, or the Right Mix

Michael S. Lauer
Download PDF
https://doi.org/10.1161/CIRCRESAHA.114.303627
Circulation Research. 2014;114:1080-1082
Originally published March 27, 2014
Michael S. Lauer
From the Office of the Director, Division of Cardiovascular Sciences, National Heart, Lung, and Blood Institute, Bethesda, MD.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Info & Metrics

Jump to

  • Article
    • Introduction
    • Acknowledgments
    • Disclosures
    • Footnotes
    • References
  • Figures & Tables
  • Info & Metrics
  • eLetters
Loading
  • biomedical research
  • economics
  • National Heart, Lung, and Blood Institute

Introduction

Late June, 1969, at a suburban Philadelphia day camp. There was much to look forward to: color war, soccer, nature hikes, bug juice, barbecues, swimming, softball, and, of course, no school! But I paid little attention, as for me these paled compared with the upcoming big event, the much-anticipated launch of Apollo 11, the rocket that would fulfill President Kennedy’s call to land men on the moon and bring them back home. During the next few weeks, my parents and I spent hours glued to the TV; and my parents quietly endured the smell of glue emanating from model rockets and lunar modules taking form in my room.

Some 20 years later, Bernadine Healy, Director of the National Institutes of Health, called for a moon shot for women’s health. The resulting Women’s Health Initiative (WHI) would be a big science effort that would invest substantial resources, enabling scientists to address questions about hormone replacement therapy, supplementation with Vitamin D and calcium, and diet as interventions that might prevent serious health conditions faced by postmenopausal women. Like National Aeronautics and Space Administration’s moon shot, the National Institutes of Health’s WHI succeeded1; a national team of top-notch scientists enrolled well over 100 000 women into several randomized trials and observational studies. The surprising findings of the relative harms of hormone replacement therapy led to sweeping changes in clinical practice and likely played a role in the past decade’s decline in breast cancer incidence.

Now, 25 years later, American science and engineering face an uncertain future. Although big science projects have always generated controversy, shrinking budgets have invited only more criticism. The United States invests a lower proportion of its Gross Domestic Product into research and development than several other economically developed nations.2 Of perhaps greater concern, there has been a steady decline in public support of science; whereas in the 1960s the federal government provided two third of research funds, today it only provides 1 of 3.2 At the National Institutes of Health, there has been a steady decade-long decline of purchasing power. At the National Heart, Lung, and Blood Institute (NHLBI), this has translated into lower pay lines, with the institute awarding 36% fewer new R01 grants than it did 10 years ago.

Some prominent thought leaders have argued that the National Institutes of Health and other funders need to rethink seriously their business models.3 Instead of funding a smaller number of big science projects, projects like the WHI, government research agencies, they argue, should rediscover small science, science that is based on the work of many scientists working in many settings, each getting relatively small sums of money to do their work.4 NHLBI Project Officers often hear skeptics of big science initiatives ask questions like, How many R01s will we have to sacrifice in order for your big project to happen?

So what strategy should an agency like the NHLBI take? Should we aim to fund more small projects, meaning low-budget investigator—initiated R01s?5 Should we trim back on our big science projects, such as relatively expensive clinical trials and epidemiology studies?6 Should we stop funding trials and epidemiological projects altogether or insist on shifting to low-cost pragmatic alternatives that leverage rapidly evolving information technologies? And what about projects that involve highly innovative, but risky technologies or candidate therapies, where cheap options are few or absent? And if we are to fund a mix of big and small science, to follow the maxim of a diversified portfolio,7 what’s the right mix? And how do we determine, in advance, which projects constitute the right strategy?

Prominent thought leaders have struggled with these questions. Some, like Gregory Petsko,8 argue that “the right way to direct science is almost not to direct it all,” but rather allow priorities to set themselves through “the free exchange of ideas in the scientific literature, in meetings, and in review panels.” Others, like Vermeulen et al,9 counter that they are “less sanguine about [this] belief that the scientific community alone has the capacity to ascertain the practical value of particular lines of inquiry.” Stuart Firestein10 points out that science by its nature is based on ignorance and that it is nary impossible to predict which technologies and hypotheses will succeed. We recently published a report showing that percentile rankings of NHLBI R01 grants were unable to predict subsequent academic productivity.11

Others wonder whether big science investments are worth the opportunity costs, the pathways foregone because of monies directed elsewhere. Bruce Alberts,4 the former editor of Science, worried that laboratory-based investigators are being crowded out of the decreasing funding pool in part because “the scale [of big science projects] creates a constituency that makes these projects difficult to stop, even where there are clear signs of diminishing returns.” Nobel laureates Joseph Goldstein and Michael Brown worry about an even deeper impact, namely a harmful change in fundamental scientific paradigms. They recently lamented that “individual curiosity-driven science has been replaced by large consortia dedicated to the proposition that gathering vast amounts of correlative data will somehow provide the answer to life’s fundamental questions.”12 The science economist Paula Stephan summarized the conundrum when she wrote that “we just don’t know” whether it is “better to spend $3 billion on the Human Genome Project or to support 6,000 researchers each to the tune of $500,000?” Megaprojects, like epidemiological cohorts, that “provide inputs for more research down the road” but don’t by themselves provide answers “are especially difficult to evaluate.”13

In his AAAS (American Association for the Advancement of Science) Presidential Address, William Press noted that science is heavy tailed, meaning that a small number of efforts will account for most of the impact2; Nasim Taleb14 describes this phenomenon as extremistan, meaning “a process where the total can conceivably be impacted by a single observation … also called ‘fat tailed.’” At the NHLBI, we too observe such a pattern. The Pareto plot in the Figure shows 2-year citation data for 118 070 articles published between 1990 and 2010 and supported by ≥1 NHLBI R01 or R21 grant. More than 75% of the citations were generated by just 30% of the articles, whereas 40% of the articles generated fewer than 2% of the citations.

Figure.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure.

Pareto plot of 2-year citations for 118 070 articles funded by National Heart, Lung, and Blood Institute R01 or R21 grants and published between 1990 and 2010. The x axis divides the number of articles according number of 2-year citations. The bars show the sum of 2-year citations within each decile, whereas the line graph shows cumulative values going from the best- to the worst-producing deciles of articles. The top 3 deciles (that is, the 30% most frequently cited articles) generated 75% of the citations.

Despite the unquestionable successes of previous big science investments, I worry that in a time of unprecedented fiscal constraints big science presents an existential threat to the invaluable offerings of small science. As stewards of scarce public monies, we at National Institutes of Health have an even more pressing responsibility than in years past to consider explicitly the opportunity costs of new or renewed large-scale projects that diminish our ability to support individual laboratories. How many paradigm-changing, yet wholly unpredictable, discoveries will be lost? We should also worry about the impact on our ability to nurture science trainees, who not only are aware of decreasing chances for funding, but also will have fewer opportunities to be exposed to the individual, curiosity-driven science that Goldstein and Brown credited with enabling a series Nobel-winning breakthroughs.12

So, what might be the characteristics of worthy big science projects? As Stephan13 writes, it may be impossible to come up with definitive answers, given the small sample size—by definition big science projects are few in number—and the uncertainties about how to measure outcome. But thinking back on my experiences, I might offer a few suggestions. There were some prima facie successes, such as the Apollo moon shots, the WHI, the Hubble telescope, and the nation’s research attacks on infectious diseases such as AIDS and polio.

So, here are 6 suggested criteria for prospective evaluation of large-scale projects in our current era of ever shrinking resources:

  1. Will it capture the public imagination? The Apollo moon shots sure captured my 8-year-old boy sense of wonder. Abraham Lincoln once remarked that anything is possible but only with the backing of public sentiment. Admittedly, some highly worthwhile projects, like discovering the molecular structure of DNA, may be difficult to communicate to a lay audience.

  2. Is government leadership and financial support critical for success? Some projects would not happen on their own because no one private party has the financial incentives to embark on them.

  3. Is there a clear, measurable, and achievable objective? In July 1969, we could say unequivocally that we sent men to the moon and back. Some objectives may be less clear, but the WHI trials were finished and did lead to marked changes in practice, and today AIDS, at least in the United States, is a chronic disease, not the fast-paced killer it once was. Some large-scale projects have enabled the scientific community to better understand where to shift investments; for example, Mendelian randomization studies15 that leverage discoveries stemming from the Human Genome Project may inform worthwhile and less worthwhile lines of inquiry.

  4. Is it—in a timely manner—stretching new technological and organizational capabilities? The moon shot was possible because of recently developed rocketry technologies, the advent of high-power computers, and strong partnerships between the private and public sectors. In today’s parlance, we might ask whether a new project leverages contemporary scientific advances or resources.

  5. Is it possible to proceed in measured stages? And to learn from inevitable stumbles and failures? The manned space program started with the small Mercury rockets, then the bigger Gemini missions that sent 2 men up at once and tested the ability to dock orbiting spacecraft, and only then the giant Apollo rockets. Even so there were bumps, even tragic disasters, along the way. Clayton Christensen,16 an expert in innovation, urges open-minded organizations to discover and exploit disruptive technologies by planning to fail often, quickly, and inexpensively.

  6. Irrespective of success or failure, will something be learned and will there be the courage to stop? Or at least recognize when it is time to scale back so as to allow new efforts with emerging priorities to get their turn. This question is particularly important, but difficult, indeed gut-wrenching, during a time of shrinking resources.

A few weeks ago, National Aeronautics and Space Administration posted a video that recreated the events, leading to the famous Apollo 8 photograph of earthrise. I enjoyed watching it, and even more so, sharing it and my boyhood recollections with my 2 college-age sons who are both planning careers in science or engineering. I also shared this essay with them, and I must admit that despite the amazing accomplishments of the moon program, I advised for the short term that they seek training opportunities in the kind of nurturing individual curiosity-driven laboratories that Goldstein and Brown12 benefitted from during their formative years. In the long term, I hope that they will be able to thrive and contribute to a scientific and technological enterprise that sees its share of great achievements, whether they come from big science, small science, or whatever the right mix is.

Acknowledgments

I am grateful to over a dozen colleagues from National Heart, Lung, and Blood Institute and from other National Institutes of Health Institutes who provided me with constructive comments on prior versions of this article. I am also grateful to 2 anonymous peer reviewers for their excellent thoughtful suggestions.

Disclosures

None.

Footnotes

  • The views expressed in this paper are those of the author and do not necessarily reflect those of the National Heart, Lung, and Blood Institute, the National Institutes of Health, or the US Federal Government.

  • Nonstandard Abbreviation and Acronym
    WHI
    Women’s Health Initiative

  • © 2014 American Heart Association, Inc.

References

  1. 1.↵
    1. Nabel EG
    . The Women’s Health Initiative–a victory for women and their health. JAMA. 2013;310:1349–1350.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Press WH
    . Presidential address. What’s so special about science (and how much should we spend on it?). Science. 2013;342:817–822.
    OpenUrlFREE Full Text
  3. 3.↵
    1. Langer JS
    . Enabling scientific innovation. Science. 2012;338:171.
    OpenUrlAbstract/FREE Full Text
  4. 4.↵
    1. Alberts B
    . The end of “small science”? Science. 2012;337:1583.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    1. Fortin JM,
    2. Currie DJ
    . Big science vs. little science: how scientific impact scales with funding. PLoS One. 2013;8:e65263.
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Rosbash M
    . A threat to medical innovation. Science. 2011;333:136.
    OpenUrlAbstract/FREE Full Text
  7. 7.↵
    1. Galis ZS,
    2. Hoots WK,
    3. Kiley JP,
    4. Lauer MS
    . On the value of portfolio diversity in heart, lung, and blood research. Am J Respir Crit Care Med. 2012;186:575–578.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Petsko GA
    . Big science, little science. EMBO Rep. 2009;10:1282.
    OpenUrlFREE Full Text
  9. 9.↵
    1. Vermeulen N,
    2. Parker JN,
    3. Penders B
    . Big, small or mezzo? Lessons from science studies for the ongoing debate about ‘big’ versus ‘little’ research projects. EMBO Rep. 2010;11:420–423.
    OpenUrlFREE Full Text
  10. 10.↵
    1. Firestein S
    Ignorance: How it Drives Science. New York, NY: Oxford University Press;2012.
  11. 11.↵
    1. Danthi N,
    2. Wu CO,
    3. Shi P,
    4. Lauer M
    . Percentile ranking and citation impact of a large cohort of national heart, lung, and blood institute-funded cardiovascular r01 grants. Circ Res. 2014;114:600–606.
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    1. Goldstein JL,
    2. Brown MS
    . History of science. A golden era of Nobel laureates. Science. 2012;338:1033–1034.
    OpenUrlAbstract/FREE Full Text
  13. 13.↵
    1. Stephan PE
    How Economics Shapes Science. Cambridge, MA: Harvard University Press;2012.
  14. 14.↵
    1. Taleb NN
    Antifragile: Things That Gain From Disorder. New York, NY: Random House;2012.
  15. 15.↵
    1. Voight BF,
    2. Peloso GM,
    3. Orho-Melander M,
    4. et al
    . Plasma HDL cholesterol and risk of myocardial infarction: a mendelian randomisation study. Lancet. 2012;380:572–580.
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Christensen CM
    The Innovator’s Dilemma: When New Technologies Cause Great Firms to Fail. New York, NY: HarperBusiness;2000.
View Abstract
Back to top
Previous ArticleNext Article

This Issue

Circulation Research
March 28, 2014, Volume 114, Issue 7
  • Table of Contents
Previous ArticleNext Article

Jump to

  • Article
    • Introduction
    • Acknowledgments
    • Disclosures
    • Footnotes
    • References
  • Figures & Tables
  • Info & Metrics

Article Tools

  • Print
  • Citation Tools
    Personal Reflections on Big Science, Small Science, or the Right Mix
    Michael S. Lauer
    Circulation Research. 2014;114:1080-1082, originally published March 27, 2014
    https://doi.org/10.1161/CIRCRESAHA.114.303627

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
  •  Download Powerpoint
  • Article Alerts
    Log in to Email Alerts with your email address.
  • Save to my folders

Share this Article

  • Email

    Thank you for your interest in spreading the word on Circulation Research.

    NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

    Enter multiple addresses on separate lines or separate them with commas.
    Personal Reflections on Big Science, Small Science, or the Right Mix
    (Your Name) has sent you a message from Circulation Research
    (Your Name) thought you would like to see the Circulation Research web site.
  • Share on Social Media
    Personal Reflections on Big Science, Small Science, or the Right Mix
    Michael S. Lauer
    Circulation Research. 2014;114:1080-1082, originally published March 27, 2014
    https://doi.org/10.1161/CIRCRESAHA.114.303627
    del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo

Related Articles

Cited By...

Subjects

  • Quality and Outcomes
    • Ethics and Policy

Circulation Research

  • About Circulation Research
  • Editorial Board
  • Instructions for Authors
  • Abstract Supplements
  • AHA Statements and Guidelines
  • Permissions
  • Reprints
  • Email Alerts
  • Open Access Information
  • AHA Journals RSS
  • AHA Newsroom

Editorial Office Address:
3355 Keswick Rd
Main Bldg 103
Baltimore, MD 21211
CircRes@circresearch.org

Information for:
  • Advertisers
  • Subscribers
  • Subscriber Help
  • Institutions / Librarians
  • Institutional Subscriptions FAQ
  • International Users
American Heart Association Learn and Live
National Center
7272 Greenville Ave.
Dallas, TX 75231

Customer Service

  • 1-800-AHA-USA-1
  • 1-800-242-8721
  • Local Info
  • Contact Us

About Us

Our mission is to build healthier lives, free of cardiovascular diseases and stroke. That single purpose drives all we do. The need for our work is beyond question. Find Out More about the American Heart Association

  • Careers
  • SHOP
  • Latest Heart and Stroke News
  • AHA/ASA Media Newsroom

Our Sites

  • American Heart Association
  • American Stroke Association
  • For Professionals
  • More Sites

Take Action

  • Advocate
  • Donate
  • Planned Giving
  • Volunteer

Online Communities

  • AFib Support
  • Garden Community
  • Patient Support Network
  • Professional Online Network

Follow Us:

  • Follow Circulation on Twitter
  • Visit Circulation on Facebook
  • Follow Circulation on Google Plus
  • Follow Circulation on Instagram
  • Follow Circulation on Pinterest
  • Follow Circulation on YouTube
  • Rss Feeds
  • Privacy Policy
  • Copyright
  • Ethics Policy
  • Conflict of Interest Policy
  • Linking Policy
  • Diversity
  • Careers

©2018 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. The American Heart Association is a qualified 501(c)(3) tax-exempt organization.
*Red Dress™ DHHS, Go Red™ AHA; National Wear Red Day ® is a registered trademark.

  • PUTTING PATIENTS FIRST National Health Council Standards of Excellence Certification Program
  • BBB Accredited Charity
  • Comodo Secured