|
|
||||||||
RESEARCH AND PRACTICE |
Colin Loftin and David McDowall are with the Violence Research Group, School of Criminal Justice, University at Albany, State University of New York. Brian Wiersema is with the Violence Research Group, Department of Criminology and Criminal Justice, University of Maryland, College Park. Adam Dobrin is with the Department of Criminology and Criminal Justice, Florida Atlantic University, Boca Raton.
Correspondence: Requests for reprints should be sent to Colin Loftin, PhD, Violence Research Group, School of Criminal Justice, University at Albany, SUNY, 135 Western Ave, Albany, NY 12222 (e-mail: cloftin{at}albany.edu).
| ABSTRACT |
|---|
|
|
|---|
Objectives. This study assessed the consistency of estimates of the number of justifiable homicides committed by US police officers and identified sources of underreporting.
Methods. The number of justifiable homicides committed by police officers between 1976 and 1998 was estimated from supplementary homicide report (SHR) and National Vital Statistics System (NVSS) mortality data.
Results. Nationally, the SHR estimate was 29% larger than the NVSS estimate. However, in most states this pattern was reversed, with more deaths reported in the NVSS.
Conclusions. Both systems underreport, but for different reasons. The NVSS misclassifies cases as homicides, rather than justifiable homicides committed by police officers, because certifiers fail to mention police involvement. The SHR misses cases because some jurisdictions fail to file reports or omit justifiable homicides committed by police officers. (Am J Public Health. 2003;93:11171121)
| INTRODUCTION |
|---|
|
|
|---|
Also, the perception that police devalue the lives of some citizens may reduce citizen cooperation in reporting crime or assisting police in investigations and may generally degrade the quality of justice.6 The ability to accurately assess the incidence and characteristics of justifiable homicides committed by police officers is central to the development and evaluation of policies that promote public health and safety.
In the United States, 2 national systemsthe Uniform Crime Reporting Program of the Federal Bureau of Investigation (FBI) and the National Vital Statistics System (NVSS) of the National Center for Health Statisticscollect information on homicides committed by law enforcement officers in the line of duty. Research conducted with special populations suggests that both systems underreport the number of citizens killed by police officers.710 However, there has been no comprehensive comparison of estimates from the 2 systems.
In this study, we took advantage of the presence of multiple reporting systems and assessed the consistency of estimates from the 2 systems during the 23-year period encompassing 1976 through 1998. We show here that both systems underreport the number of justifiable homicides committed by police officers, and we identify major sources of undercounting.
| BACKGROUND: THE 2 SURVEILLANCE SYSTEMS |
|---|
|
|
|---|
Uniform Crime Reporting Program
The Uniform Crime Reporting Program relies on the voluntary participation of state and local law enforcement agencies in submitting monthly information about crime. The FBI coordinates the program, but many states also have coordinating agencies that forward information from local agencies to the FBI.
The key form in regard to assessing the number of justifiable homicides committed by police officers is the supplementary homicide report (SHR), which collects information (victim and offender characteristics, relationship between victim and offender, weapon, and circumstances) on each homicide incident reported by a given agency. Among other items, the SHR provides a short field in which agencies are instructed to "furnish a brief statement as to the circumstances surrounding the victims death."12 This information is coded, according to Uniform Crime Reporting Program guidelines, by staff of the state agency or the FBI.
If the description of the circumstance mentions that the decedent was killed by a police officer or other "peace officer" (persons with specified legal authority to use deadly force) acting in the line of duty, the case should be coded as a justifiable homicide committed by the police. Agencies are instructed to provide information based on the initial police investigation, not on subsequent decisions made by prosecutors or courts.
National Vital Statistics System
Production of NVSS data can be divided into 2 general phases, certification and classification. State laws require the certification of all deaths, and, in the case of homicides, they require certification by a medical examiner or coroner. Medical certifiers supply information about cause and manner of death, whereas other information is typically collected and entered by funeral directors. The certificate, when complete, is filed with a designated registrar of the district in which the death occurred.1315
In terms of identification of justifiable homicides committed by the police, the 2 essential items on the death certificate are (1) the manner-of-death statement (wherein the certifier selects from the following options: natural, accident, suicide, homicide, pending investigation, or could not be determined) and (2) an open text field that asks the certifier to "describe how the injury occurred." Instructions for completing these items do not mention justifiable homicides committed by the police or explicitly indicate that police involvement should be mentioned. The handbook that provides instructions for medical examiners and coroners simply states the following:
Briefly and clearly describe how the injury occurred, explaining the circumstances or cause of the accident or injury, such as "fell off ladder while painting house," "ran off roadway," or "cartruck collision." For motor vehicle accidents, indicate whether the decedent was a driver, passenger, or pedestrian.16(p39)
Certifiers do not directly classify the case as a justifiable homicide committed by the police, nor are they required to certify whether the killing was legally justifiable.
In the classification phase, the information from the death certificate is used to classify cause of death according to the International Classification of Diseases (ICD). Information on manner of death (homicide, suicide, unintentional) is combined with information on underlying cause of death by means of the ICD E-codes used for deaths due to injury and poisoning.17 The classification should be correct if the certifier designates manner of death as a homicide and indicates, in the "describe how the injury occurred" statement, that the decedent was killed by the police.
| METHODS |
|---|
|
|
|---|
We obtained SHR18,19 and NVSS20 data for 1976 (the year after an extensive revision of the SHR21) through 1998 (the most recent year for which data were available). SHR cases were geographically classified according to the locale (police jurisdiction) in which the injury occurred, whereas NVSS cases were classified by place of death. Only deaths occurring in the 50 states and the District of Columbia were included. Incident-level SHR data were converted to a victim-level format so that they were consistent with the NVSS data.
The SHR and NVSS case definitions were logically equivalent. For the SHR, we counted justifiable homicides committed by police officers, defined as the "killing of a felon by a peace officer in the line of duty."12(p6) For the NVSS, we counted deaths in which the underlying cause was attributed to legal interventions, defined as "injuries inflicted by the police or other law enforcement agents, including military on duty, in the course of arresting or attempting to arrest law breakers, suppressing disturbances, maintaining order, and other legal action" in accord with codes E970 through E977 of the eighth (ICD-8) and ninth (ICD-9) revisions of the ICD.22,23 We excluded legal executions (code E978). The definitions just described specify a subset of homicides distinguished by the legal authorization of the agent and the act. Neither system is intended to include illegal killings committed by police officers.
The changes in collection procedures that occurred during the study period should not have affected estimates of the number of justifiable homicides committed by police. Although the FBI began accepting data in a new format in 1998, the system preserves all of the elements of the SHR.24 In the case of the NVSS, revisions in US standard certificates of death in 1978 and 1989 changed the format of the manner-of-death item, explicitly including the option "pending investigation" (in 1978) and reformatting the item as a checkbox and adding "natural" to the list (in 1989).11,25,26 Furthermore, there were no changes in the definition of homicide or legal intervention between the ICD-8 (used from 1968 through 1978) and the ICD-9 (used from 1979 through the end of our study period). The comparability ratio (estimate of the number of cases using the ICD-9 relative to the number using the ICD-8) for homicide and legal intervention was 1.0057 (95% confidence interval [CI] = 0.9999, 1.0115).27
According to the National Center for Health Statistics, the NVSS data cover more than 99% of US deaths.28 Comparable SHR estimates of number of homicide deaths were not available. The FBI has reported that the law enforcement agencies participating in the Uniform Crime Reporting Program represent between 95%29 and 98%30 of the US population; these figures are not applicable to the SHR, however, because some participating agencies do not submit the SHR form or submit fewer than 12 monthly reports.13 No adjustments were made in the case of the SHR public use data files for nonreporting and partially reporting agencies.
Coverage differences also arose because federal law enforcement agencies do not participate in the Uniform Crime Reporting Program. If killings committed by federal law enforcement agents (including members of the military acting as peace officers) occur in state and local jurisdictions, they are covered by the SHR. However, if they occur in an area under federal jurisdiction (such as a national park, federal prison, or military base), they are not reported in the SHR.13
Whereas the NVSS imputed missing data for race,28 the SHR assigned a missing data code. In the case of age, the SHR included an "unknown" category, and the NVSS included a "not stated" category. Annual state residential population estimates were obtained from the US Bureau of the Census.3133
| RESULTS |
|---|
|
|
|---|
|
The number of cases reported by the SHR exceeded the number reported by the NVSS in most sex, race, and age categories. More SHR than NVSS cases were reported among White and Black decedents (Table 1
) and in every age category between 10 and 60 years (Table 2
). There were relatively few cases and small differences between the systems in regard to decedents of unknown race and decedents older than 69 years. Also, small numbers of female cases were reported in both systems; over the 23-year period, the SHR reported only 206 female cases, whereas the NVSS reported 179.
|
|
When cases were stratified by state, a different pattern was revealed. In contrast to the excess of the SHR over the NVSS in terms of the number of cases reported nationwide, more than half of the states (29) reported more NVSS than SHR cases. The pattern is clear in Figure 2
, in which the states and the District of Columbia are ranked according to ratio of SHR to NVSS counts. The aggregate national difference favoring the SHR is caused by a systematic relationship between state population sizes and the excess of SHR over NVSS cases. States reporting more SHR cases tended to have larger populations than did states reporting more NVSS cases (Pearson r = 0.58 between ratio of SHR to NVSS counts and mean study period population). The most prominent example was California, with 1089 more cases reported in the SHR than in the NVSS, but Texas, New York, Illinois, Pennsylvania, Michigan, and other large states also reported more SHR cases than NVSS cases.
|
| DISCUSSION |
|---|
|
|
|---|
In the case of the NVSS, the major reason for underreporting is that certifiers fail to indicate on the death certificate that the death was caused by a police officer. If there is no mention of police involvement, the case will be misclassified as a homicide. There is considerable evidence that omission of police involvement from the description of how the injury occurred is responsible for the misclassification of legal interventions as homicides. First, studies of the validity of homicide classification based on death certificates have shown that legal interventions are misclassified as homicides.7,8,10 Second, a study conducted by the New York State Commission on Criminal Justice and the Use of Force revealed that, during the 5-year period 1981 through 1985, only 38% of the 223 cases identified in police agency records as justifiable homicides were correctly classified in death certificate records. In all of the misclassified cases, the death certificate failed to indicate that the decedents death was caused by a police officer (New York State Commission on Criminal Justice and the Use of Force, unpublished data, 1987).
Third, in a supplementary study, we examined copies of the death certificates of 16 decedents known, on the basis of police and medical examiner records, to have died as a result of legal interventions that occurred in Maryland during 1995. In each of the 7 cases in which the certifier mentioned the police in the "describe how the injury occurred" statement, the case was correctly classified as a legal intervention. In contrast, in the 9 cases in which there was no mention of the police, the cases were classified as homicides.
It is unknown why certifiers fail to mention police involvement or why some law enforcement agencies do not include justifiable homicides committed by the police in the SHR. If such information is to be supplied, it must be known that the death was caused by the police, the relevance of the information must be recognized, and the will to provide the information must be present. A national sample of cases of known justifiable homicides committed by police officers should be examined to determine how the factors described operate to reduce reporting. Although general-purpose data systems such as vital statistics systems and the Uniform Crime Reporting Program cannot provide the same level of accuracy as studies focusing specifically on homicides committed by police officers,37,38 a better understanding of the structure of errors would suggest ways to improve the quality of reporting.
As it stands, however, there is a need for accurate and reliable ongoing surveillance of reports of justifiable homicides. Ideally, such a surveillance system would provide the detail necessary to adequately describe the circumstances surrounding justifiable homicides committed by police officers, an element that neither the existing SHR nor the NVSS can supply. If it is unrealistic to recommend fundamental changes to existing data systems, it may be worthwhile to explore the option of designing a new, more reliable and comprehensive system.
Because both the SHR and NVSS underreport in systematic ways, existing data should be used cautiously. The correlation between the annual series, along with the correlation between the monthly series (not described here), implies that the SHR and NVSS follow broadly similar patterns over time. Thus, one might use the series to investigate overall national trends. Even here, however, the relationships are approximate, and inferences about changes within subgroups may be misleading.
There is reason to believe that the SHR estimates may be of use in comparisons involving large cities. Sherman and Cohn compared SHR estimates of the number of justifiable homicides committed by police officers between 1980 and 1983 with survey data they had collected from a sample of large cities.39 Although the authors reported discrepancies (differences of at least 1 case) between values in 63% of the years studied, the correlations (our calculations) between the values ranged from .95 to .97. Nevertheless, even in the case of large US cities, complete and consistent reporting of SHR data does not always occur, and extra care and caution are required when making such comparisons.
Our general conclusion is that, at present, reliable estimates of the number of justifiable homicides committed by police officers in the United States do not exist. The 2 national data systems fail to account for many cases and provide different estimates of the demographic characteristics of individuals killed by the police. Analyses of existing data should proceed cautiously.
| Acknowledgments |
|---|
Human Participant Protection
Ethical clearance for this research was obtained from the institutional review board of the University at Albany, State University of New York.
| Footnotes |
|---|
C. Loftin was the team leader, participating in all phases of the work other than assembling the data files. B. Wiersema participated in designing the study, assembled the data, confirmed tabulations of the data, created the figures, and contributed to preparation of the article. D. McDowall participated in the data analysis and contributed to the writing of the article. A. Dobrin conducted the review of related studies, interviewed data experts at state police and coroners offices, and assisted in the writing of the article.
Accepted for publication May 17, 2002.
| References |
|---|
|
|
|---|
2. Report of the National Advisory Commission on Civil Disorders. Washington, DC: National Advisory Commission on Civil Disorders; 1968.
3. Evans CA Jr. Public health impact of the 1992 Los Angeles civil unrest. Public Health Rep.1993;108:265272.[ISI][Medline]
4. Golden RE, Baranov MS. The impact of the April 1992 civil unrest on the Los Angeles REI WIC program and its participants. Public Health Rep.1994;109:606614.[ISI][Medline]
5. DiPasquale D, Glaeser EL. The Los Angeles riot and the economics of urban unrest. J Urban Economics.1998;43:5278.
6. Cullen F, Cao L, Frank J, et al. "Stop or Ill shoot": racial differences in support for police use of deadly force. Am Behav Scientist.1996;39:449460.
7. Lapidus GD, Gregorio DI, Hansen H. Misclassification of childhood homicide on death certificates. Am J Public Health.1990;80:213214.
8. Moyer LA, Boyle CA, Pollock DA. Validity of death certificates for injury-related causes of death. Am J Epidemiol.1989;130:10241032.
9. Sherman LW, Langworthy RH. Measuring homicide by police officers. J Criminal Law Criminology.1979;70:546560.
10. Van Court J, Trent RB. Matching homicide reports and death records in California. Paper presented at: Annual Meeting of the Homicide Research Working Group, June 2001, Orlando, Fla.
11. Hetzel AM. US Vital Statistics System: Major Activities and Developments, 195095. Hyattsville, Md: National Center for Health Statistics; 1997. DHHS publication PHS 97-1003.
12. Uniform Crime Reporting Handbook. Washington, DC: Federal Bureau of Investigation; 1984.
13. Rokaw WM, Mercy JA, Smith JC. Comparing death certificate data with FBI crime reporting statistics on US homicides. Public Health Rep.1990;105:447455.[ISI][Medline]
14. Hanzlick R, Combs D, Parrish RG, Ing RT. Death investigation in the United States, 1990: a survey of statutes, systems, and educational requirements. J Forensic Sci.1993;38:628632.
15. Hanzlick R. Death registration: history, methods, and legal issues. J Forensic Sci.1997;42:265269.[ISI][Medline]
16. Medical Examiners and Coroners Handbook on Death Registration and Fatal Death Reporting. Hyattsville, Md: National Center for Health Statistics; 1987.
17. Centers for Disease Control and Prevention. Recommended framework for presenting injury mortality data. MMWR Morb Mortal Wkly Rep.1997;46(RR-14):130.[Medline]
18. Uniform Crime Reporting Program data: supplementary homicide reports, 19761997 [electronic data files]. Available at: http://www.icpsr.umich.edu/. Accessed February 28, 2001.
19. Uniform Crime Reporting Program data: supplementary homicide report, 1998 [electronic data file]. Available at: http://www.icpsr.umich.edu/. Accessed February 28, 2001.
20. Mortality Detail Data/Multiple Cause of Death for ICD-9 Data [electronic data files]. Hyattsville, Md: National Center for Health Statistics; 19761998.
21. Riedel M. Sources of homicide data: a review and comparison. In: Smith MD, Zahn MA, eds. Homicide: A Sourcebook of Social Research. Thousand Oaks, Calif: Sage Publications; 1999:7595.
22. Manual of the International Statistical Classification of Diseases, Injuries, and Causes of Death: Based on the Recommendations of the Eighth Revision Conference, 1965, and Adopted by the Nineteenth World Health Assembly. Geneva, Switzerland: World Health Organization; 1967.
23. Manual of the International Statistical Classification of Diseases, Injuries, and Causes of Death: Based on the Recommendations of the Ninth Revision Conference, 1975, and Adopted by the Twenty-Ninth World Health Assembly. Geneva, Switzerland: World Health Organization; 1977.
24. Crime in the United States 1996. Washington, DC: Federal Bureau of Investigation; 1997.
25. Dundon ML, Gay GA, George JL. The 1978 revision of the US Standard Certificates. Vital Health Stat 4. 1983;No. 23:158.
26. Tolson GC, Barnes JM, Gay GA, Kowaleski JL. The 1989 revision of the US Standard Certificates and Reports. Vital Health Stat 4. 1991;No. 28:134.
27. Klebba AJ, Scott JH. Estimates of selected comparability ratios based on dual coding of 1976 death certificates by the eighth and ninth revisions of the International Classification of Diseases. Month Vital Stat Rep. February 29, 1980;28(11).
28. Technical appendix. In: Vital Statistics of the United States 1987, Volume IIMortality, Part A. Hyattsville, Md: National Center for Health Statistics; 1990:122. DHHS publication PHS 90-1101.
29. Crime in the United States 1999. Washington, DC: Federal Bureau of Investigation; 2000.
30. Crime in the United States 1977. Washington, DC: Federal Bureau of Investigation; 1978.
31. US Bureau of the Census. Intercensal estimates of the total resident population of states: 1970 to 1980. Available at: http://www.census.gov/population/estimates/state/stts/st7080ts.txt. Accessed August 24, 2001.
32. US Bureau of the Census. Intercensal estimates of the total resident population of states: 1980 to 1990. Available at: http://www.census.gov/population/estimates/state/stts/st8090ts.txt. Accessed August 24, 2001.
33. US Bureau of the Census. State population estimates: annual time series, July 1, 1990 to July 1, 1999. Available at: http://www.census.gov/population/estimates/state/st-99-3.txt. Accessed August 24, 2001.
34. Enders W. Applied Econometric Time Series. New York, NY: John Wiley & Sons Inc; 1995.
35. Wiersema B, Loftin C, McDowall D. A comparison of supplementary homicide reports and National Vital Statistics System homicide estimates for US counties. Homicide Stud.2000;4:317340.
36. Maltz MD. Bridging Gaps in Police Crime Data. Washington, DC: Bureau of Justice Statistics; 1999. NCJ publication 176365.
37. Rosenberg HM, Freedman MA. Accurate ascertainment of child-abuse mortality [letter]. JAMA.2000;283:337.
38. Zemach R. What the vital statistics system can and cannot do. Am J Public Health.1984;74:756758.
39. Sherman LW, Cohn EG. Citizens Killed by Big City Police, 19701984. Washington, DC: Crime Control Institute; 1986.
This article has been cited by other articles:
![]() |
R D Comstock, S Mallonee, and F Jordan A comparison of two surveillance systems for deaths related to violent injury Inj. Prev., February 1, 2005; 11(1): 58 - 63. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |