Policy Forum
Aug 2021
Peer-Reviewed

How Does Cost-Effectiveness Analysis Inform Health Care Decisions?

David D. Kim, PhD and Anirban Basu, PhD
AMA J Ethics. 2021;23(8):E639-647. doi: 10.1001/amajethics.2021.639.

Abstract

Cost-effectiveness analysis (CEA) provides a formal assessment of trade-offs involving benefits, harms, and costs inherent in alternative options. CEA has been increasingly used to inform public and private organizations’ reimbursement decisions, benefit designs, and price negotiations worldwide. Despite the lack of centralized efforts to promote CEA in the United States, the demand for CEA is growing. This article briefly reviews the history of CEA in the United States, highlights advances in practice guidelines, and discusses CEA’s ethical challenges. It also offers a way forward to inform health care decisions.

Background

Decision makers in health care often face challenging questions. Should clinicians check every adult’s blood pressure? Should a health plan’s drug formularies cover a new and expensive drug? How should vaccines or treatments be priced in a pandemic? Answers to these questions require careful examination of potential trade-offs involving benefits, harms, and costs associated with policies or health interventions to determine the optimal choice.1

One approach to aid such decisions is to conduct a cost-effectiveness analysis (CEA) that explicitly quantifies the relative costs and benefits of alternative interventions.2,3 It aims to illuminate the potential trade-offs and inform discussions of whether the additional resources demanded by an intervention (over an alternative) are worth the additional gain in health produced by it.4 A CEA expresses this trade-off using a metric called the incremental cost-effectiveness ratio (ICER).5 The ICER can be regarded as a “price” for an additional unit of health gained through an intervention. Like lower prices, a smaller ratio is more favorable because it implies that an intervention can produce an incremental health gain at a lower cost. ICERs are often compared to a range of predetermined threshold values that reflect the willingness to pay for an additional unit of health gain from the perspective taken. For example, the willingness-to-pay threshold usually ranges from $100 000 to $150 000 per additional unit of health gain measured by quality-adjusted life-years (QALYs) in the United States.6,7,8 It implies that if the ICER for the intervention lies below the chosen threshold, it is deemed cost-effective.

Since the 1990s, the number of CEAs has grown substantially, covering a wide range of diseases and interventions.9,10,11 In the United States and abroad, many public and private organizations have formally adopted a health technology assessment (HTA) process that uses ICERs to inform reimbursement decisions, benefit designs, and price negotiations.12,13 The rest of this article offers a brief on the use of CEA in US health care, highlights advances in CEA practice guidelines, discusses ethical challenges of using CEA for health care decisions, and suggests a way forward.

Cost-Effectiveness Analysis in the United States

Unlike many other developed countries where CEA has been incorporated into the formal HTA process,11,13 the United States has resisted following suit. One exception is the use of cost-effectiveness evidence by the Centers for Disease Control and Prevention’s Advisory Committee on Immunization Practices to inform national recommendations on immunization policy.14 However, a growing concern about inefficient health care spending has led to the incorporation of value (typically measured by ICERs using QALY as the measure of health gain) into organizations’ health care decisions and practice guidelines.15,16 For example, the Institute for Clinical and Economic Review (ironically, with the moniker ICER), a US-based nonprofit organization, applies systematic and evidence-based approaches—including CEAs—to assess the value of various health technologies.7 Medical professional societies and other organizations have also developed practice guidelines incorporating value measured by ICERs, for example.17

Nevertheless, the use of cost-effectiveness evidence to inform health care decisions faces challenges and opposition from policymakers, the drug industry, and patient advocates. Our fragmented health care system with its various key players diminishes the incentive to consider the broader implication of resource allocation decisions.18 Some resistance to CEA pertains to Americans’ aversion to rationing and unwillingness to accept limits in the delivery of health care.19,20 Methodological challenges—often based on incomplete evidence (eg, the need to extrapolate clinical trial data beyond follow-up periods), CEA’s limited applicability in assessing effectiveness in the real-world setting, and judgment calls made by the analyst—have contributed to the mistrust of results.20,21,22 Although how well and how widely CEA will be accepted and implemented in the United States remains to be seen, CEA methods have been substantially improved to meet some of these challenges.

Advances in Cost-Effectiveness Analysis

In 1996, the US Public Health Service’s Panel on Cost-Effectiveness in Health and Medicine established a reference case analysis, a set of standard methodologies to improve the quality and comparability of CEAs that emphasized using QALY as a health outcome measure and applying a societal perspective.2 A QALY measures the value of health gains as a function of both being alive and the quality of health captured by health-related quality-of-life weight.23 QALYs enable comparison of well-being related to health across patients, diseases, and treatments—a necessary step to inform resource allocation decisions. The panel also endorsed a broader societal perspective because considering everyone affected and counting all benefits and costs, regardless of who gains or loses, can provide the basis for fair decisions in the public interest.2,24 The societal perspective accounts for disease and intervention-related nonhealth impact, including patient time, patient transportation, unpaid caregiver time, productivity loss, and spillover impact on other sectors, such as education.10

A QALY measures the value of health gains as a function of both being alive and the quality of health captured by health-related quality-of-life weight. 

Twenty years later, the Second Panel on Cost-Effectiveness in Health and Medicine was convened to provide an updated guideline reflecting methodological advances in evidence synthesis, modeling, uncertainty analysis, and consideration of ethical and distributional issues.3 The table summarizes reference case analyses of the field’s major guidelines. One of the second panel’s significant updates was the recommendation of 2 reference case analyses: one from a health care sector perspective and another from a societal perspective.25 The second panel recognized that the use of a societal perspective had declined since 2000 while a narrower health care sector or payer perspective persists in most published CEAs.10 The failure to apply a societal perspective might reflect (1) difficulties in defining nonhealth impact (eg, lost productivity or reductions in resource consumption) associated with a particular disease or an intervention, (2) absence of available data to quantify nonhealth impact, and (3) international guidelines that endorse a narrower health care sector or payer perspective, which may better represent the interests of particular budget holders who are not generally concerned about nonhealth impact that falls outside of their budget.

Table. Comparisons of Reference Case Analyses in Cost-Effectiveness Analysis Guidelines

 

Reference case analyses

Elements of analyses

1st US Panel
(1996)2

UK NICE
reference case (2013)26

Gates/iDSI
reference case
(2014)27

2nd US Panel
(2016)3

ICER value assessment framework
(2020)7

Perspective

Societal

National Health Service

Health care sector

Societal & health care sector

Societala & health care sectorb

Comparators

Available & feasible options (including existing practice and a do-nothing option, as appropriate)

Measurement of health effects

QALYs gained

QALYs gained

DALYs averted

QALYs gained

QALYs gained &
equal value life-years gained

Time horizon

Long enough to capture all relevant future consequences (eg, lifetime)

Discountingc

3.0%

3.5%

3.0%

3.0%

3.0%

Evidence

Use of all relevant evidence (eg, systematic and transparent approach)

Nonhealth impactd

Should be included

If relevant, should be identified and reported separately

If relevant, should be identified & reported separately

Should be included

Should be included in scenario analysis for its modified societal perspective

Abbreviations: DALYs, disability-adjusted life years; ICER, Institute for Cost-Effectiveness Research; iDSI, International Decision Support Initiative; NICE, National Institute for Health and Care Excellence; QALYs, quality-adjusted life years.
aThe Institute for Comparative Economic Research recommends a modified societal perspective analysis as a scenario analysis. However, when the societal costs of care for any disease are large relative to the direct health care costs and the impact of treatment on these costs is substantial (ie, there are substantial differences in the cost-effectiveness findings between the 2 perspectives), the societal perspective is included as a co-base case, presented directly alongside the health care sector perspective analysis.
bPrimary base case.
cCosts and benefits.
dNonhealth impact refers to nonhealth effects of disease and its treatment, including patient time, transportation costs, caregiver time, productivity, and other nonhealth care sector impacts on education, criminal justice, housing, and environment.

Nevertheless, the second panel recognized the importance of capturing nonhealth impact that matters to the broader society, recommending that analysts attempt to quantify nonhealth impact and include it in estimates of value (eg, ICER) unless the effect is likely negligible.25 The second panel advised the use of an “impact inventory,” a structured table listing an intervention’s health and nonhealth impact, to improve analyses conducted from a societal perspective.25 The structured table can signal to audiences which health and nonhealth effects have been included in or excluded from analyses and whether analyses are likely to under- or overestimate the value of an intervention. For example, when analyzing policy and health interventions related to the COVID-19 pandemic, accounting for nonhealth impact is essential for generating reliable and comprehensive estimates of an intervention’s full value.28

Ethical Considerations

There have been a few criticisms on ethical grounds of CEA’s use for decision making. These include (1) controversies associated with the use of QALYs, (2) distributive justice, and (3) incomplete valuation. We discuss each of them in detail here. However, it is worth pointing out that cost-effectiveness evidence is only one of many factors considered in resource allocation decisions. We have found that none of the international HTA bodies bases its decisions solely on cost-effectiveness evidence. Therefore, much of CEA’s criticisms, fair or not, can be addressed through deliberative processes.29

QALYs. The lower health utility, or health-related quality of life, assigned to patients with worse health (because of more severe disease, disability, age, and so on) raises distributional issues in using QALYs for resource allocation decisions. For example, because patients with disabilities have a lower overall health utility weight, any extension of their lives by reducing the health burden from one disease “would not generate as many QALYs as a similar extension of life for otherwise healthy people.”30 This distributional limitation arises because of the multiplicative nature of QALYs, which are a product of life-years and health utility weight. Consequently, the National Council on Disability has strongly denounced the use of QALYs.31

Alternatives to QALYs have been proposed. The Institute for Clinical and Economic Review has started using the equal value of life-years gained metric,32 a modified version of the equal value of life (EVL) metric,33 to supplement QALYs. In EVL calculations, any life-year gained is valued at a weight of 1 QALY, irrespective of individuals’ health status during the extra year.34 EVL, however, “has had limited traction among academics and decision-making bodies” because it undervalues interventions that extend life-years by the same amount as other interventions but that substantially improve quality of life.30 More recently, a health-years-in-total metric was proposed to overcome the limitations of both QALYs and EVL, but more work is needed to fully understand its theoretical foundations.30

Distributive justice. The second criticism pertains to the fundamental notion that “a QALY is a QALY is a QALY no matter who gets it.”35 Because of this egalitarian notion, the question of whose values shall count for how much raises some ethical issues. For example, should large benefits to a small number of people receive priority over smaller but greater aggregate benefits to a large number of people? Or when should society give priority to treating the sickest or worst off?36,37,38,39,40 However, CEA was not meant to address such distributional considerations directly. The Second Panel on Cost-Effectiveness in Health and Medicine emphasized that such distributive considerations also matter to decision makers and are often part of deliberative processes.3,4 Areas of ongoing research include the development of equity weights, which assign numerical values based on considerations other than QALYs (eg, the severity or rarity of the disease), and incorporating social distributions of health (eg, by income or ethnicity) into CEA.41,42,43

Incomplete valuation. The third criticism relates to CEA’s consideration (or lack thereof) of certain value elements. Many HTA bodies around the world use CEA from a health care sector perspective and do not incorporate value elements such as productivity, time costs, caregivers’ costs, and spillover to other sectors of the society.10 Even in the United States, ICER has not considered these elements formally, although more recently it has allowed for a modified societal perspective as a secondary analysis.7 The Second Panel on Cost-Effectiveness in Health and Medicine, which recommends analyses using both the health care sector perspective and the societal perspective, has laid out the methods for incorporating such value elements.3 Often, lack of data (eg, the effect of a treatment on productive time) precludes analysts from including some of these value elements in the analysis, even though they are generally believed to be important to patients and their caregivers. Although recent advances in measuring these value elements have provided a set of useful resources,44,45 more work is needed to readily incorporate these elements into standard CEA.

Informing Decision Making

Resources to improve health are always limited. It is impossible to provide all the interventions that offer health benefits without sacrificing resources that could be used for other desirable and important goals, such as education. Consequently, whether explicitly or implicitly, some form of prioritization or rationing is unavoidable. Without considering opportunity cost, we would not know whether better use of those resources was possible; choosing an intervention in ignorance of opportunity costs cannot be deemed ethical, either. Although it does not capture all relevant concerns, CEA is a systematic and explicit way of assessing a given decision’s opportunity cost.

In the United States, a step forward would be the establishment of a national HTA agency that formally incorporates cost-effectiveness evidence along with other contextual elements, such as distributional concerns and budget impact. With a transparent, scientifically rigorous, and deliberative process of assessing trade-offs among alternative health policies or interventions, such an agency could provide valuable information to better inform resource allocation decisions in health care, including value-based prices for price negotiations.

References

  1. Weinstein MC, Stason WB. Foundations of cost-effectiveness analysis for health and medical practices. N Engl J Med. 1977;296(13):716-721.
  2. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-Effectiveness in Health and Medicine. Oxford University Press; 1996.

  3. Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-Effectiveness in Health and Medicine. 2nd ed. Oxford University Press; 2016.

  4. Neumann PJ, Sanders GD. Cost-effectiveness analysis 2.0. N Engl J Med. 2017;376(3):203-205.
  5. Sanders GD, Maciejewski ML, Basu A. Overview of cost-effectiveness analysis. JAMA. 2019;321(14):1400-1401.
  6. Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness—the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796-797.
  7. Institute for Clinical and Economic Review (ICER). 2020-2023 Value Assessment Framework. January 31, 2020. Updated October 23, 2020. Accessed June 10, 2021. https://icer.org/wp-content/uploads/2021/03/ICER_2020_2023_VAF_013120-4-2.pdf

  8. Vanness DJ, Lomas J, Ahn H. A health opportunity cost threshold for cost-effectiveness analysis in the United States. Ann Intern Med. 2021;174(1):25-32.
  9. Neumann PJ, Thorat T, Shi J, Saret CJ, Cohen JT. The changing face of the cost-utility literature, 1990-2012. Value Health. 2015;18(2):271-277.
  10. Kim DD, Silver MC, Kunst N, Cohen JT, Ollendorf DA, Neumann PJ.  Perspective and costing in cost-effectiveness analysis, 1974-2018. Pharmacoeconomics. 2020;38(10):1135-1145.
  11. Pharmacoeconomic guidelines around the world. International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Accessed February 10, 2021. https://tools.ispor.org/peguidelines/

  12. World Health Organization. 2015 global survey on health technology assessment by national authorities. World Health Organization; 2015. Accessed June 10, 2021. https://www.who.int/health-technology-assessment/MD_HTA_oct2015_final_web2.pdf

  13. Kristensen FB. Mapping of HTA Methodologies in EU and Norway. Directorate-General for Health and Food Safety, European Commission; June 2017. Accessed June 10, 2021. https://ec.europa.eu/health/sites/default/files/technology_assessment/docs/2018_mapping_methodologies_en.pdf

  14. Leidner AJ, Chesson HW, Meltzer MI, Messonnier ML, Lee GM, Prosser LA. Guidance for health economics studies presented to the Advisory Committee on Immunization Practices (ACIP), 2019 update. Centers for Disease Control and Prevention; 2019. Accessed September 30, 2020. https://www.cdc.gov/vaccines/acip/committee/downloads/Economics-Guidance-for-ACIP-2019.pdf

  15. Garrison LP Jr, Neumann PJ, Willke RJ, et al. A health economics approach to US value assessment frameworks—summary and recommendations of the ISPOR Special Task Force report [7]. Value Health. 2018;21(2):161-165.
  16. Neumann PJ, Willke RJ, Garrison LP Jr. A health economics approach to US value assessment frameworks—introduction: an ISPOR Special Task Force report [1]. Value Health. 2018;21(2):119-123.
  17. Neumann PJ, Cohen JT.  Measuring the value of prescription drugs. N Engl J Med. 2015;373(27):2595-2597.
  18. Neumann PJ. American exceptionalism and American health care: implications for the US debate on cost-effectiveness analysis. Office of Health Economics briefing 47. March 2009. Accessed July 20, 2021. https://www.ohe.org/system/files/private/publications/321%20-%20Briefing_Neumann.pdf?download=1

  19. Gold MR, Sofaer S, Siegelberg T. Medicare and cost-effectiveness analysis: time to ask the taxpayers. Health Aff (Millwood). 2007;26(5):1399-1406.
  20. Neumann PJ. Why don’t Americans use cost-effectiveness analysis? Am J Manag Care. 2004;10(5):308-312.

  21. Eddy DM. Clinical decision making: from theory to practice. Cost-effectiveness analysis. Is it up to the task? JAMA. 1992;267(24):3342-3348.

  22. Rennie D, Luft HS. Pharmacoeconomic analyses: making them transparent, making them credible. JAMA. 2000;283(16):2158-2160.
  23. Neumann PJ, Cohen JT. QALYs in 2018—advantages and concerns. JAMA. 2018;319(24):2473-2474.
  24. Russell LB, Fryback DG, Sonnenberg FA. Is the societal perspective in cost-effectiveness analysis useful for decision makers? Jt Comm J Qual Improv. 1999;25(9):447-454.

  25. Sanders GD, Neumann PJ, Basu A, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: Second Panel on Cost-Effectiveness in Health and Medicine. JAMA. 2016;316(10):1093-1103.
  26. National Institute for Health and Care Excellence. Guide to the Methods of Technology Appraisal 2013. April 4, 2013. Accessed October 3, 2020. https://www.nice.org.uk/process/pmg9/resources/guide-to-the-methods-of-technology-appraisal-2013-pdf-2007975843781

  27. Wilkinson T, Sculpher MJ, Claxton K, et al. The International Decision Support Initiative reference case for economic evaluation: an aid to thought. Value Health. 2016;19(8):921-928.
  28. Kim DD, Neumann PJ. Analyzing the cost effectiveness of policy responses for COVID-19: the importance of capturing social consequences. Med Decis Making. 2020;40(3):251-253.
  29. Bond K, Stiffell R, Ollendorf DA. Principles for deliberative processes in health technology assessment. Int J Technol Assess Health Care. Published online August 4, 2020.

  30. Basu A, Carlson J, Veenstra D. Health years in total: a new health objective function for cost-effectiveness analysis. Value Health. 2020;23(1):96-103.
  31. National Council on Disability. Quality-Adjusted Life Years and the Devaluation of Life With Disability. November 6, 2019. Accessed February 16, 2021. https://ncd.gov/sites/default/files/NCD_Quality_Adjusted_Life_Report_508.pdf

  32. Institute for Clinical and Economic Review (ICER). The QALY: rewarding the care that most improves patients’ lives. December 2018. Accessed October 8, 2020. https://icer.org/wp-content/uploads/2020/12/QALY_evLYG_FINAL.pdf

  33. Johannesson M. Should we aggregate relative or absolute changes in QALYs? Health Econ. 2001;10(7):573-577.

  34. Nord E, Pinto JL, Richardson J, Menzel P, Ubel P. Incorporating societal concerns for fairness in numerical valuations of health programmes. Health Econ. 1999;8(1):25-39.
  35. Williams A. Cost-effectiveness analysis: is it ethical? J Med Ethics. 1992;18(1):7-11.

  36. Brock DW. Priority to the worse off in health care resource prioritization. In: Rhodes R, Battin MP, Silvers A, eds. Medicine and Social Justice: Essays on the Distribution of Health Care. Oxford University Press; 2002:362-372.

  37. Rawls J. A Theory of Justice. Harvard University Press; 2009.

  38. Nord E, Johansen R. Concerns for severity in priority setting in health care: a review of trade-off data in preference studies and implications for societal willingness to pay for a QALY. Health Policy. 2014;116(2-3):281-288.
  39. Nord E. The trade-off between severity of illness and treatment effect in cost-value analysis of health care. Health Policy. 1993;24(3):227-238.
  40. Kamm FM. Morality, Mortality. Volume 1: Death and Whom to Save From It. Oxford University Press; 1993.

  41. Asaria M, Griffin S, Cookson R, Whyte S, Tappenden P. Distributional cost-effectiveness analysis of health care programmes—a methodological case study of the UK Bowel Cancer Screening Programme. Health Econ. 2015;24(6):742-754.
  42. Verguet S, Laxminarayan R, Jamison DT. Universal public finance of tuberculosis treatment in India: an extended cost-effectiveness analysis. Health Econ. 2015;24(3):318-332.
  43. Cookson R, Griffin S, Norheim OF, Culyer AJ. Distributional Cost-Effectiveness Analysis: Quantifying Health Equity Impacts and Trade-Offs. Oxford University Press; 2020.

  44. Prosser LA, Wittenberg E. Advances in methods and novel applications for measuring family spillover effects of illness. Pharmacoeconomics. 2019;37(4):447-450.
  45. Grosse SD, Pike J, Soelaeman R, Tilford JM. Quantifying family spillover effects in economic evaluations: measurement and valuation of informal care time. Pharmacoeconomics. 2019;37(4):461-473.

Editor's Note

Background image by Lauren Beatty.

Citation

AMA J Ethics. 2021;23(8):E639-647.

DOI

10.1001/amajethics.2021.639.

Conflict of Interest Disclosure

Dr Basu received consulting fees through Salutis Consulting, LLC on other projects. No funds were received for the current work. Dr Kim had no conflicts of interest to disclose.

The viewpoints expressed in this article are those of the author(s) and do not necessarily reflect the views and policies of the AMA.