|
|
||||||||
RESEARCH |
Eran Bellin is with the Department of Outcomes Analysis and Decision Support, Montefiore Medical Center, and the Department of Epidemiology and Social Medicine, Albert Einstein College of Medicine, Bronx, NY. Nancy Neveloff Dubler is with the Division of Bioethics, Montefiore Medical Center, and the Department of Bioethics, Albert Einstein College of Medicine, Bronx, NY.
Correspondence: Requests for reprints should be sent to Eran Bellin, MD, Montefiore Medical Center, Department of Outcomes Analysis and Decision Support, 55 E Gun Hill Rd, Bronx, NY 10467 (e-mail: ebellin{at}montefiore.org).
| ABSTRACT |
|---|
|
|
|---|
Historically, quality assurance studies have received scant ethical attention. The advent of information systems capable of supporting research-grade continuous quality improvement projects demands that we clearly define how these projects differ from research and when they require external review. The ethical obligation for the performance of quality assurance projects, with its emphasis on identifiable immediate action for a served population, is a critical distinction. The obligation to perform continuous quality improvement is a deliverable of the social contract entered into implicitly by patients and health care providers and systems.
In this article, the authors review the ethical framework that requires these studies, evaluate the differences between quality assurance studies and classic research, and propose criteria for requiring external review.
| INTRODUCTION |
|---|
|
|
|---|
Ideally, continuous quality improvement should involve reviewing all records and being constantly vigilant. It should be a nearly concurrent retrospective surveillance of patients seen in the immediate past, while there remains the opportunity to intervene both in the patient's care and in the practitioner's perception of the events. Its data analyses should be sufficiently comprehensive to detect the systems that failed to prevent human error.68 No human review of paper records has these 2 characteristics. Only automated examinations of the footprints of the clinical encounter stored in electronic medical information systems can hope to accomplish these objectives.
In this article, we explore the differences between continuous quality improvement and research and suggest that some of the interventions proposed in the name of quality improvement raise competing ethical considerations that, like research, need external review for their adjudication.
| THE SUBJECT OF QUALITY IMPROVEMENT |
|---|
|
|
|---|
The first patterna dramatic deviation from the expected outcome, as in the sentinel event of unexpected deathwas the subject of historical quality assurance. The seconda reasonable outcome despite a less-than-optimal processis a warning that the system is not in control and may deteriorate further, resulting in an adverse event or a pattern of preventable morbidity. As an example, consider increasing delays in emergency department triage time. At first, the increased delays are merely disturbing; however, should a critically ill patient present, the previously disturbing delay can prove catastrophic. The delay is a latent erroran accident waiting to happen.
The third categorya reasonable outcome with an acceptable process that might be further improved beyond the prevailing standardwill soon be identifiable with computerized clinical tracking. As an example, there has been a common practice of keeping patients with uncomplicated community-acquired pneumonia in the hospital on intravenous antibiotics for 1 day after their fever has remitted. Given that few of these patients require intervention on their last day, a careful review would show that an earlier discharge would arguably be appropriate, thus lowering costs and reducing the risks of iatrogenic complications.
Because of the differing severities of consequence, each of the above scenarios has a different urgency. All are quality improvement and should be monitored as technology permits.
| WHY QUALITY ASSURANCE WAS NOT CONSIDERED RESEARCH |
|---|
|
|
|---|
In the same period, researchers developed a new and powerful paradigmthe double-blind, prospective, randomized controlled trial.11,12 This archetype of clinical research shares no common characteristics with the extant "bad eventfocused quality assurance" process (Table 1
). Research seeks generalizable knowledge because appropriate therapy is not known. Quality assurance classically assumes that the appropriate therapy is known and that departures from the known standard should be identified and corrected.
|
With the advent of cohort creation as a quality assurance tool, the significantly enhanced sophistication of the statistical methods used, and the breadth and depth of the electronic database available, the superficial distinctions have vanished. We are now forced to confront the substantive differences and to establish rational expectations of oversight appropriate to function rather than to label.
| ETHICAL FRAMEWORK |
|---|
|
|
|---|
The ethical obligations of health care institutions derive from multiple sources. First, the health care institution is a natural extension of physician practice and, so being, is bound by professional oaths and ethics to promote the patient's best interests.13,14 The compact of trust between patient and physician encompasses the expectation that the care provided will be characterized by skill, judgment, attention, and concern. The health care organization demonstrates this concern through a rigorous, continuous quality improvement process.
Second, the institution is a distinct moral agent with responsibilities separate from and in addition to those of the individuals who compose it.1518 The notion of moral agency has particular significance for the health care institution, because its coordination of the efforts of many people is essential to create the fundamental gooda health benefit. As an example, mammography screening for breast cancer is a deliverable requiring a scheduling secretary, a registration clerk, an x-ray technician, a radiologist to interpret, a secretary to type, a clerk to put the results in the chart, and a clinician with interpretive and interpersonal skills to communicate results to the patient. Without the coordinated activity of all, effective screening would not be accomplished. The organization takes the moral responsibility19 for maintaining quality at each of the distinct steps that, in the aggregate, lead to the health goodbreast cancer screening.
A third argument derives from the construct of the social contract. Society has traditionally granted medicine hegemony in the guardianship of patient health, in exchange for which physicians are obligated to practice according to accepted standards and promote patient well-being through quality assurance review.20 A similar social contract with health care organizations must be made explicit. Without this organizational acceptance of ethical responsibility, less ethically committed health care organizations will exploit the natural variation in the medical practice of individual clinicians, selecting the cheap and potentially substandard while off-loading responsibility to the individual clinician when accountability for bad outcomes is demanded. This ethically dubious risk transfer scheme shifts the responsibility for detection and remediation to the party least able to collect and analyze the datathe individual physician.
With rare exceptions,21,22 individual physicians are incapable of monitoring events in the aggregate among their patient population to detect unacceptable practice patterns and outcomes. The information technology infrastructure of hospitals or managed care consortiums has this unique capability, from which flows a distinct ethical responsibility to monitor.
| ETHICAL IMPERATIVE AND ETHICAL CONSTRAINTS |
|---|
|
|
|---|
Experimental interventions intrude upon the usual assumptions of the physicianpatient relationship. In daily practice, physicians are ethically required to choose the most efficacious, least harmful therapies on the basis of knowledge, judgment, and intuition. In the experimental research paradigm, with the appropriate consent of the patient and within well-defined constraints, both the patient and the physician subordinate this process to the rigid methodologies of the study. The potentially conflicting ethical values inherent in this radically changed relationship make the jurisdiction of an independent review panel mandatory. This requirement to review extends beyond clinical trials, as even chartreview research, with its far less intrusive process, requires a balancing of ethical values of privacy against potential societal benefit.25,26
Clinical research falls into the category of an ethically permissible rather than a morally and legally mandatory activity. Whereas society supports research to advance knowledge, no particular individual or institution is obligated to perform research, and subject participation is optional.
In contrast to medical practice, where discussion of risks and benefits may be subsumed in physician advice,27 the risks inherent in clinical research are clearly identified in the review process of the IRB; the IRB must evaluate scientific merit (since a protocol that will not produce useful data can support no risk), determine that risks of the protocol are reasonable given the anticipated benefits, and review the process of informed consent.28 The IRB is charged with sensitizing hypothesis-focused investigators to the issues of protecting human subjects and counterbalancing the potential for exploiting the doctorpatient relationship.
Clinical research derives much of its legitimacy from its generalizability. Many researchers see ethical responsibility as ending at publication. This lack of connectedness to an immediately benefited patient population is the very reason that IRBs evaluate scientific merit, since others must incorporate the findings into their practice for there to be an ultimate public benefit.
The continuous quality improvement process is embedded in an organizational matrix committed to using the results of the study to inform immediately the process of care. It is this feedback loop, with its expectation of responsiveness, that motivates and legitimates continuous quality improvement reviews. Statistical rigor and sound methodology further enhance the ethical legitimacy of continuous quality improvement.
Quality improvement projects that review practice for conformance with accepted norms require no external oversight. Their activities are mandatory and inherently legitimate. Their major ethical challenge has been maintaining patient privacy, allowing for exceptions for the shortest period of time necessary for evaluation with the subsequent elimination of identifiers. Future ethical challenges will include preventing the continuous quality improvement process from succumbing to the single-minded focus of cost containment, with the potential of jeopardizing patient well-being.
The random assignment of standard or alternative treatments or placebosthe hallmark of the gold standard, the double-blind, randomized controlled trialis not a component of classic quality improvement projects. With the assignment of therapy comes a whole range of responsibilities and considerations that, for clinical research, have been in the scientific and ethical purview of a review body external to the researchersthe IRB.2932 The IRB must be convinced that the better practice is not known at the time the study is initiated. Clinical equipoise33 must be established at the outset of the study and must be continuously present as the study progresses. Monitoring the accumulated data for statistical significance and for the shattering of equipoise is the ongoing responsibility of the data and safety monitoring boards that are increasingly required by good research practice.
| THE GREAT DIVIDE |
|---|
|
|
|---|
Prospective interventional studies, even when sponsored by the clinical authority responsible for quality improvement, require external scrutiny. We present 3 examples.
Example 1
A health maintenance organization (HMO) would like to test the efficacy and cost of 2 established therapies for hypertension. Under present practice standards, the HMO can differentially reimburse patients or reward physicians for compliance with the cost-saving standard. Suppose the HMO wished to rigorously evaluate its approach to care by randomizing patients to 1 of 2 strategies. It is clear that such a study requires review by an IRB and informed consent. Even though the primary endpoint, hypertension control, can be achieved through either therapy, the side-effect profiles are different. Patients have a right to expect that their physicians will optimize their treatment both for the primary endpoint and with consideration for their preferences for side effects. At the very least, patients expect an honest relationship with the physician and expect to be told if some motivation other than their best interest is driving the decision. The fact that the HMO can virtually order the use of a particular regimen by restricting its formulary is immaterial. If it differentially assigns therapy to explore outcome, it engages in research.
Example 2
An HMO wishes to test whether the provision of 5 follow-up in-home nursing evaluations of patients discharged from the hospital with a diagnosis of congestive heart failure will ultimately reduce rehospitalizations or emergency room visits enough to offset the cost of the program. No one will be denied the standard package of services, and this service is believed to provide benefit without risk. We argue that external review is required. We are chastened by the history of research that has demonstrated our inability to distinguish the purely helpful from the possibly dangerous.34,35 We can envision a scenario where the increased nursing services might bring iatrogenic riskwrong advice from the visiting nurse or miscommunication between the physician and the visiting nurse. More important, the patient and family may have privacy concerns and may object to having strangers imposed on them. In addition to these theoretic concerns, we believe, requiring oversight of this "experiment," even though it is an extremely benign example, will have created a preemptive protective zone of prohibition that will provide a useful precedent. Informed consent should be required either at the outset or after randomization for all those who will be offered the intervention.
Example 3
A continuous quality improvement department is trying to decide whether investing the resources for the ongoing review of care of AIDS patients is worth the effort. It has the technical computer capability to review automatically, on a monthly basis, the CD4 counts, viral loads, and medications of all of its patients. The costly part of the intervention would be convening case reviews and patient interviews to attempt to improve the outcome of care. To answer the question rigorously, the study design must create 2 de facto standards of care in the clinic. Were the clinic to prospectively assign intervention differentially, there would be no question that this would be research and IRB review would be required. In a clever manipulation, however, the continuous quality improvement department randomizes one half of the patients to monthly computer quality improvement review. The restriction of quality improvement review to a randomly selected subset is clearly within the quality improvement tradition. Those randomized to surveillance who are found to be failing their therapies are reported to the medical director.
Once presented with evidence that individuals are not achieving desired endpoints, the director of the AIDS clinic decides to convene 3 senior physicians to discuss those patients. The team reviews the charts for evidence of medical errors, examining the appointment log and prescription pickup record for evidence of noncompliance. The director then develops a program to ensure improved compliance or improved attention to standards of care by physicians for the identified patients.
The intervention is generated by the clinical director independently of the randomization. The collection of data morally compels the director to provide "the best standard of care" but does not formally assign the rest of the clinic to an inferior standard. The standard care of the other patients in the clinic is not functionally interfered with by the medical director, who is ignorant of any flaws in their care. After a year of this creative manipulation, the computer system is asked to review the clinical outcomes of both groups.
At no point in this process has there been a formal violation of continuous quality improvement procedure or practice, nor has there been specific assignment of intervention; however, this is clearly a technical manipulation to avoid the designation of research and to sidestep external review. While the study itself might be legitimate, the manipulation makes it a potentially dangerous model. In addition, the lack of a formal review process and of an honest design precludes the use of interim statistical analyses, through which the department might find benefit early, end the "trial," and provide the intervention to the "control group."
In this last example, the line between research and continuous quality improvement is the most permeable. Prudence and a respect for the history of research and the excesses of medical researchers demand protection for patients and accountability for clinician-researchers, whether within or outside of the continuous quality improvement process. The open discussion of the protocol, even if the dangers to any patient randomized to care are exceedingly remote, promotes the values of transparency and patient-informed choice, which hidden assignment would preclude.
| CONCLUSIONS |
|---|
|
|
|---|
In the history of research, the abuse of human subjects led to the creation of clear guidelines for the review of research protocols.3640 IRBs examine the possible risks and benefits for the subjects and approve the informed consent process that is designed to educate and empower prospective subjects. This review is necessitated by the experience that research protocols can either provide benefit or actually harm subjects and on the ethical premise that voluntary informed consent must precede assumption of risk.
Prospective quality improvement evaluations that allocate treatment with or without randomization to different cohortsgenerally to identify the most cost-effective care but sometimes to identify best practiceshould, like research, be subject to review and should trigger considerations of informed consent. This rule should apply whether or not generalizable information is created for public presentation or dissemination.
We suggest that each institution create a collaborative process with the IRB to establish a standing committee on quality improvement. It is hoped that with experience, the IRB and the continuous quality improvement departments would come to jointly agree on which designs are quality improvement that may proceed without IRB review and which are sufficiently hybridized to require review. We make this suggestion knowing full well that IRBs are presently under enhanced scrutiny regarding standards of practice, but hoping that in the review of IRB responsibility and authority these considerations of an enhanced agenda will be included. This augmented workload should hasten enhanced financial and administrative support for these deliberative panels.
In the days before managed care, the conflicts addressed by the IRB were those that might pit the interests of the researcher against those of the patient-subject. At present, the greatest threat to patient well-being may be those administrative decisions that intrude on physician discretion as a way of cutting the costs of care. Much of the quality improvement process is retrospective or concurrent surveillance designed to improve health care delivery against a defined agreed-upon standard. Some activities, however, intervene prospectively and should be reviewed by an IRB to ensure that they do not compromise patient autonomy or safety.
| Footnotes |
|---|
Accepted for publication January 9, 2001.
| References |
|---|
|
|
|---|
46 (1991).
2.
NY Pub Health,
2805-M (2000).
3. What Every Hospital Should Know About Sentinel Events. Oakbrook Terrace, Ill: Joint Commission on Accreditation of Healthcare Organizations; 2000.
4. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press; 1999.
5. President's Advisory Commission on Consumer Protection and Quality in the Health Care Industry. Quality First: Better Health Care for All Americans: Final Report to the President of the United States. Washington, DC: US Government Printing Office; 1998.
6. Kazandjian VA, Lied TR. Healthcare Performance Measurement: Systems Design and Evaluation. Milwaukee, Wis: Quality Press; 1999.
7. Kelley LD. How to Use Control Charts for Healthcare. Milwaukee, Wis: Quality Press; 1999.
8. Altman L. Big doses of chemotherapy drug killed patient, hurt 2nd. New York Times. April 24, 1995:A18.
9.
Code of Federal Regulations. Public Welfare (Protection of Human Subjects), 45 CFR
46.102(d) (1991).
10. Donabedian A. The Definition of Quality and Approaches to Its Assessment. Ann Arbor, Mich: Health Administration Press; 1980.
11. Feinstein AR. Current problems and future challenges in randomized clinical trials. Circulation.1984;705:767774.
12. Byar DP, Simon RM, Friedewald WT, et al. Randomized clinical trials: perspectives on some recent ideas. N Engl J Med.1976;295:7480.[Abstract]
13. Ahronheim JC, Moreno J, Zuckerman C. Ethics in Clinical Practice. New York, NY: Little Brown & Co; 1994.
14. Pellegrino ED, Thomasina DC. For the Patient's Good: The Restoration of Beneficence in Health Care. New York, NY: Oxford University Press; 1998.
15. French P. The corporation as a moral person. Am Philos Q.1979;3:207215.
16. Spencer EM. Organizational Ethics in Health Care. New York, NY: Oxford University Press; 2000.
17. Blustein JB, Post LF, Dubler NN. A Handbook on Organizational Ethics: Theory, Cases and Tools for Implementation. New York, NY: United Hospital Fund. In press.
18. Spencer EM, Whitley EM, Healey GF. A corporate approach to health care ethics. HEC Forum.1995;75:296301.
19. Goodpaster K, Mathews JB Jr. Can a corporation have a conscience? In: Donaldson T, Werhane P, eds. Ethical Issues in Business. 3rd ed. Englewood Cliffs, NJ: Prentice Hall; 1982:139149.
20. Arras JD. The fragile web of responsibility: AIDS and the duty to treat. Hastings Cent Rep.1988;18:1020.
21. Codman EA. A Study in Hospital Efficiency: As Demonstrated by the Case Report of the First Five Years of a Private Hospital. Boston, Mass: Th Todd Co; 1918.
22. Pickles WN. Epidemiology in Country Practice. Bristol, England: John Wright & Sons Ltd; 1939.
23. 1999 Hospital Accreditation Standards. Oakbrook Terrace, Ill: Dept of Publications, Joint Commission on Accreditation of Healthcare Organizations; 1999.
24.
Iglehart JK. The National Committee for Quality Assurance. N Engl J Med.1996;335:995999.
25.
Hyman SE. The need for database research and for privacy collide. Am J Psychiatry.2000;157:17231724.
26.
Simon GE, Unutzer J, Young BE, Pincus HA. Large medical databases, population-based research, and patient confidentiality. Am J Psychiatry.2000;157:17311737.
27. Katz J. Informed consent: must it remain a fairy tale? J Contemp Health Law Policy.2000;10:67.
28.
Code of Federal Regulations. Public Welfare (Protection of Human Subjects), 45 CFR
46.108 (1991).
29. Brett A, Grodin M. Ethical aspects of human experimentation in health services research. JAMA.1991;265:18541857.[Medline]
30.
Doyal L, Tobias JS, Warnock M, Power L, Goodare H. Informed consent in medical research. BMJ.1998;316:10001005.
31.
Smith R. Informed consent: the intricacies. BMJ.1997;314:10591060.
32. Lynn J, Johnson J, Levine RJ. The ethical conduct of health services research: a case study of 55 institutions' applications to the SUPPORT project. Clin Res.1994;421:310.
33. Freedman B. Equipoise and the ethics of clinical research. N Engl J Med.1987;317:141145.[Abstract]
34. Rogers WJ, Epstein AE, Arciniegas JG, et al. Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. The Cardiac Arrhythmia Suppression Trial (CAST) Investigators. N Engl J Med.1989;321:406412.[Abstract]
35. Ruskin JN. The Cardiac Arrhythmia Suppression Trial (CAST). N Engl J Med.1989;321:386388.[Medline]
36.
Code of Federal Regulations. Public Welfare (Protection of Human Subjects), 45 CFR
46.405 (1991).
37. World Medical Association Declaration of Helsinki. Recommendations guiding physicians in biomedical research involving human subjects. Cardiovasc Res.1997;351:23.
38. Shuster E. The Nuremberg Code: Hippocratic ethics and human rights. Lancet.1998;351:974977.[Medline]
39. King PA. Twenty years after: the legacy of the Tuskegee Syphilis Study: the dangers of differences. Hastings Cent Rep.1992;22:3538.[Medline]
40. Yankauer A. The neglected lesson of the Tuskegee Study [letter]. Am J Public Health.1998;88:1406.
This article has been cited by other articles:
![]() |
H. A. Taylor and S. Johnson Ethics of Population-Based Research J. Law Med. Ethics, June 1, 2007; 35(2): 295 - 299. [PDF] |
||||
![]() |
C. Grady Quality Improvement and Ethical Oversight Ann Intern Med, May 1, 2007; 146(9): 680 - 681. [Full Text] [PDF] |
||||
![]() |
L. S. Gonzalez III, S. Miller, D. Barnhart, and M. Leifheit Institutional review board approval of projects presented as posters at an ASHP Midyear Clinical Meeting Am. J. Health Syst. Pharm., September 15, 2005; 62(18): 1890 - 1893. [Full Text] [PDF] |
||||
![]() |
J. W. Mold and K. A. Peterson Primary Care Practice-Based Research Networks: Working at the Interface Between Research and Quality Improvement Ann. Fam. Med, May 1, 2005; 3(suppl_1): S12 - S20. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. V. Perneger Why we need ethical oversight of quality improvement projects Int. J. Qual. Health Care, October 1, 2004; 16(5): 343 - 344. [Full Text] [PDF] |
||||
![]() |
L Doyal Preserving moral quality in research, audit, and quality improvement Qual. Saf. Health Care, February 1, 2004; 13(1): 11 - 12. [Full Text] |
||||
![]() |
J Lynn When does quality improvement count as research? Human subject protection and theories of knowledge Qual. Saf. Health Care, February 1, 2004; 13(1): 67 - 70. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Lo and M. Groman Oversight of Quality Improvement: Focusing on Benefits and Risks Arch Intern Med, June 23, 2003; 163(12): 1481 - 1486. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |