AJPH
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow purchase articles
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Right arrow Get other permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (9)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Howell, E. M.
Right arrow Articles by Foot, B.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Howell, E. M.
Right arrow Articles by Foot, B.
January 2002, Vol 92, No. 1 | American Journal of Public Health 119-124
© 2002 American Public Health Association

RESEARCH AND PRACTICE

Deregionalization of Neonatal Intensive Care in Urban Areas

Embry M. Howell, PhD, Douglas Richardson, MD, MBA, Paul Ginsburg, PhD and Barbara Foot, MS

At the time of this study, Embry M. Howell and Barbara Foot were with Mathematica Policy Research Inc, Washington, DC. Douglas Richardson is with the Harvard Program in Newborn Medicine (Beth Israel Deaconess Medical Center, Children's Hospital, Brigham and Women's Hospital, and Harvard Medical School) and the Department of Maternal and Child Health, Harvard School of Public Health, Boston, Mass. Paul Ginsburg is with the Center for Studying Health System Change, Washington, DC.

Correspondence: Requests for reprints should be sent to Embry M. Howell, PhD, The Urban Institute, Health Policy Center, 2100 M St, NW, Washington, DC 20037 (e-mail: ehowell{at}ui.urban.org).


   ABSTRACT
TOP
 ABSTRACT
INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 References
 

Objectives. This report describes the extent of deregionalization of neonatal intensive care in urban areas of the United States in the 1980s and 1990s and the factors associated with it.

Methods. We conducted a 15-year retrospective analysis of secondary data from US metropolitan statistical areas. Primary outcome measures are number of neonatal intensive care unit (NICU) beds, number of NICU hospitals, and number of small NICUs.

Results. Growth in the supply of NICU care has outpaced the need. During the study period (1980–1995), the number of hospitals grew by 99%, the number of NICU beds by 138%, and the number of neonatologists by 268%. In contrast, the growth in needed bed days was only 84%. Of greater concern, the number of beds in small NICU facilities continues to grow. Local regulatory and practice characteristics are important in explaining this growth.

Conclusions. Local policymakers should examine the factors that facilitate the proliferation of services, especially the development of small NICUs. Policies that encourage cooperative efforts by hospitals should be developed. Eliminating small NICUs would not restrict the NICU bed supply in most metropolitan statistical areas.


   INTRODUCTION
TOP
 ABSTRACT
 INTRODUCTION
METHODS
 RESULTS
 DISCUSSION
 References
 
Care for high-risk newborns is provided in neonatal intensive care units (NICUs) in hospitals with obstetric services or in children's hospitals. According to the American Academy of Pediatrics, services in NICUs include "constant nursing and continuous cardiopulmonary and other support for severely ill infants" as well as other specialty services and technology.1 Generally, this care is provided under the supervision of neonatologists. Not all birth hospitals have NICUs; infants who are born outside of NICU hospitals and who need such services are usually transferred to the nearest NICU facility.

Research has shown that infants who are cared for in NICUs have better rates of survival than those who are not, after infant size and gestation are controlled for (see McCormick and Richardson2 for an extensive review of this literature). Another body of research has generally shown that infants born in higher-volume NICUs have better survival than those born in lower-volume facilities,3,4 although results are not completely consistent.5

To achieve the goal of optimum care for sick newborns, perinatal regionalization programs were set up around the country beginning in the early 1970s.6–8 Under a regionalized perinatal system, each facility with an obstetric service is designated as being 1 of 3 levels. Level 1 hospitals are obstetric hospitals without specialized care for newborns. Level 2 facilities, often called "intermediate care facilities," are defined by the American Academy of Pediatrics as being for "sick newborns who do not require intensive care but require 6–12 hours of nursing time each day." Level 3 facilities have NICUs. The criteria for these levels of care vary from state to state. In some states, there is a certification process for level of care, but in others there is none. Thus, the designation may not be a legal one; rather, it may be based on formal or informal agreements among hospitals, or it may be simply a hospital's self-designation.

Schwartz9 documented the growth in numbers of both intermediate and NICU beds in the 1980s, and anecdotal evidence suggests that patterns in regionalization may have changed. For example, recent case studies by Richardson et al.10 in Hartford, Conn, Menard et al.11 in South Carolina, and Yeast et al.12 in Missouri illustrate the challenges to regionalization as community hospitals add NICUs to compete for obstetric and neonatal patients.

In this study, we develop a concept of "deregionalization" associated with both the amount of NICU services and the concentration of those services. We first examine whether the proliferation of NICU facilities, beds, and physician specialists (neonatologists) is due to increased need for such services. After establishing that the rate of growth exceeds the likely need, we further explore geographic and hospital characteristics associated with growth, placing particular emphasis on whether expansions in services have occurred in smaller-than-optimal NICUs. Where the number of beds in small NICUs continues to grow, we provide evidence of a pattern of deregionalization in which hospitals establish (or maintain) their own small NICU rather than transfer infants to larger NICUs. By describing these patterns, we hope to assist policymakers in understanding the proliferation of neonatal intensive care and the deregionalization of NICU services.


   METHODS
TOP
 ABSTRACT
 INTRODUCTION
 METHODS
RESULTS
 DISCUSSION
 References
 
In this study we used data for 1980, 1990, and 1995 from the annual survey of hospitals conducted by the American Hospital Association (AHA).13 Each hospital reports its number of total beds, obstetrical beds, NICU beds, intermediate care beds, and births, as well as (through 1990) the occupancy rate for each unit.

The AHA provides a definition of NICU beds and intermediate beds for purposes of collecting data for the annual survey, a definition that has varied somewhat over time and that is also subject to considerable interpretation. For example, the AHA definition of a NICU in 1980 was as follows: "This unit provides intermediate, recovery, and intensive care." By 1995, the definition had become more specific: "A unit that must be separate from the newborn nursery providing intensive care to all sick infants including those with the very lowest birthweights (<1500 g). A NICU has the potential for providing mechanical ventilation, neonatal surgery, and special care for the sickest infants born in the hospital or transferred from another institution. A fulltime neonatologist serves as director of the NICU" (M. Janko, AHA, written communication, February 4, 1997). Since the AHA definition of NICU has become more specific over time, some beds that would have been classified as NICU beds in 1980 may have been excluded by hospitals from their NICU bed count later, possibly being reclassified as intermediate-care beds. Since the AHA survey does not specifically ask the hospital about obstetric level of care, we were led to define a "NICU hospital" (most level 3 hospitals in most states are probably included under our definition). For this report, we restricted NICU hospitals to those with at least 1 NICU bed, but we also included both reported intermediate care beds and NICU beds in such hospitals. Hospitals reporting only intermediate care beds, probably classified as level 2 hospitals in most states, were excluded from the study, although our definition may include some level 2 hospitals when they report NICU beds. We excluded level 2 hospitals because they are not clearly identified in the AHA data and the definition of level 2 is more variable from state to state than the definition of level 3. We further defined "small" NICUs, building on the study by Phibbs et al.4 showing that fragile infants had lower mortality rates in facilities with an average daily census of at least 15. Assuming an average occupancy rate of about 75%, we defined small NICUs as those with 20 beds or fewer.

The AHA survey provides data on certain other hospital characteristics that could affect the hospital's decision to operate a NICU, such as for-profit status, teaching status, and geographic location (zip code and county code). We used Atlas Select software14 to calculate the proximity of each birth hospital to its nearest NICU hospital. The distance is zero for NICU hospitals.

Metropolitan statistical areas (MSAs) are clusters of counties that are considered to be economic markets by the US Census Bureau. MSAs contained over 85% of all NICU beds in 1995. To examine market characteristics such as managed care penetration, we included only hospitals in MSAs in this study. Thus, while the findings presented here reflect the dominant pattern of NICU growth nationwide, they are not necessarily reflective of the pattern in largely rural areas. MSA boundaries are revised periodically, usually as new counties are added. For this study, we included all hospitals in any county in an MSA in 1995, whether or not the hospital was in an MSA earlier.

MSA characteristics include population size, the percentage of people with household income below the poverty level, and the proportion of the MSA population enrolled in health maintenance organizations (HMOs) in 1995 as reported by InterStudy.15 (InterStudy does not maintain consistent information for earlier years.) We included the state and census region (Northeast, South, Midwest, and West) for each hospital and MSA.

The number of neonatologists was obtained from the American Board of Medical Specialties.16 Data were summarized from individual physician records to the zip code and county level. Those who practice as neonatologists but are not board certified were excluded.


   RESULTS
TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
DISCUSSION
 References
 
There was dramatic growth nationwide in technology and manpower associated with caring for high-risk infants in the 1980s and 1990s. As shown in Table 1Go, the number of births in the period 1980 to 1995 climbed by only 17.6%, and the number of hospitals with any obstetric beds and of children's hospitals (the hospitals that may have NICUs) actually declined. By contrast, several measures of specialized services for high-risk infants grew dramatically, including (1) the number of hospitals with NICUs (98.9%), (2) the number of NICU beds (137.9%), and (3) the number of neonatologists (268.0%).


View this table:
[in this window]
[in a new window]
  		TABLE 1— —Trends in Neonatal Intensive Care Unit (NICU) Hospitals, NICU Beds, and Neonatologists: US Metropolitan Statistical Areas, 1980–1995
 
Occupancy rates in NICUs remained essentially stable between 1980 and 1990, despite the dramatic increase in the number of NICU hospitals and beds. This could be due to various factors, such as use of such beds by lower-risk infants or increased need for such beds because of increased survival of infants needing NICUs.

During the period of this study, mortality rates for very-low-birthweight infants declined, and the survivors tended to stay in NICUs for a prolonged period following birth.17,18 Table 2Go derives a partial estimate of the growth in the need for NICU beds due to increased survival of very-low-birthweight infants. It shows trends between 1980 and 1995 in the proportion of infants born weighing under 1500 g (a size that always requires NICU care when the baby survives the delivery), as well as the percentage of those small infants who survived. As shown, the total number of surviving infants under 1500 g is estimated to have risen by at least 68% within the period. Lengths of stay also increased during the period, but precise data on length of stay are not available across the full time period. Still, the growth in the need for NICU services that derives from increased survival of very-low-birthweight infants (83.8%) is substantially less than the growth in the number of available bed days. While it is possible that other changes could have contributed to the growth in need (e.g., increased survival of infants born with congenital anomalies or of higher-birthweight infants), these are unlikely to account for all of the dramatic increase in NICU services. We conclude that a portion of the growth remains unexplained by increased need, leading to a consideration of other regional and market factors that may have led to growth.


View this table:
[in this window]
[in a new window]
  		TABLE 2— —Trends in Estimated Need for Neonatal Intensive Care Unit (NICU) Beds: Metropolitan Statistical Areas, 1980–1995
 
Some might argue that much of the growth in NICUs in small MSAs may be justified, since each distinct market "deserves" at least 1 NICU to improve geographic access to needed services. Table 3Go shows that the rate of growth in the number of NICU beds was not much greater in small MSAs (147.7%) than in medium-sized (134.3%) and large (144.4%) MSAs. During this time, access to NICUs, as measured by average distance from a birth hospital to the nearest NICU, did improve more in the smallest MSAs, suggesting improved access to NICU services. There was also considerable equity across MSA size in the NICU bed supply. In 1995, small MSAs had 5.5 NICU beds per thousand births, compared with 5.4 for medium-sized MSAs and 5.0 for larger MSAs.


View this table:
[in this window]
[in a new window]
  		TABLE 3— —Neonatal Intensive Care, by Size of Metropolitan Statistical Area (MSA)
 
Whereas the smallest MSAs had an average of only a single NICU in 1995, medium-sized MSAs had an average of 2.9 NICU hospitals and the largest MSAs had an average of 9.9 such hospitals. We investigated whether deregionalization, represented by growth in the number of small NICUs, occurred during the period. Table 3Go shows that 62.4% of NICUs were smaller than the optimal size (that is, 20 or fewer beds) in 1980 and that this figure fell to 53.4% in 1995. However, while the median size of NICUs increased over the study period nationwide and in the smallest and medium-sized MSAs, the median NICU size actually declined in the largest MSAs. This suggests that in the larger MSAs, there is an opportunity for further consolidation of services into larger NICUs, where survival has been shown to be better—a process that would be facilitated by the regionalization of perinatal services.

To try to explain why deregionalization has occurred, we conducted a multivariate logistic analysis to control for some of the multiple factors that could explain the decision of a hospital to open and maintain a small NICU. As shown in Table 4, 3GoGo factors were found to significantly reduce a unit's probability of being small: (1) being housed in a teaching hospital, (2) being housed in a relatively large hospital, and (3) being located in a medium-sized or large MSA. Being located in the Northeast increased a unit's probability of being small. Notably, HMO enrollment rate, for-profit ownership, poverty rate, and the number of neonatologists per 1000 births were not associated with a hospital's NICU size. Thus, most of the market-related hypotheses were eliminated as explanations for the existence of small NICUs.


View this table:
[in this window]
[in a new window]
  		TABLE 4— —Factors Predicting the Probability of a Neonatal Intensive Care Unit's (NICU) Being Small (<=20 Beds) in 1995
 
We sought a possible explanation for why hospitals in the Northeast are more prone to establish small NICUs. Table 5Go lists all the 28 MSAs in that region that had 1 or more small NICUs in 1995. Four states—Connecticut, New Jersey, New York, and Pennsylvania—account for almost all of the 67 small NICUs in the Northeast. Pennsylvania offers the most striking situation, with 32 small NICUs spread across 11 MSAs. Almost every Pennsylvania MSA with a small NICU has at least 1 other NICU, offering the opportunity for consolidation of services. The city of Philadelphia is the most extreme example, with 16 small NICUs.


View this table:
[in this window]
[in a new window]
  		TABLE 5—Metropolitan Statistical Areas (MSAs) in the Northeast Region With at Least 1 Small Neonatal Intensive Care Unit (NICU) in 1995—
 

   DISCUSSION
TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
References
 
Our data show rapid and continued growth in neonatal intensive care in urban areas of the United States in the 1980s and 1990s. This expansion of services has increased geographic access, especially in smaller MSAs. We have shown that much of this growth occurred in NICUs that are smaller than optimal, rather than in further expansion of optimally sized NICUs, and that such a process continued through the mid-1990s. In excluding hospitals with only intermediate-care beds (i.e., level 2 hospitals) from this study, we may have underestimated the size and scope of this proliferation. Deregionalization of perinatal services is indicated by the existence of small NICUs in relatively geographically compact areas, such as in small states (e.g., Connecticut and New Jersey) and in large cities such as Philadelphia, where effective transfer programs should be able to ensure geographic access. Market-level factors, such as HMO enrollment rates, do not explain these patterns, as determined by the rather crude measures that are readily available, although more subtle market competition factors that cannot be measured with existing data may still be important.

State-specific regulatory approaches could have influenced this marked state pattern. For example, in mid-1997, 37 states maintained some form of certificate-of-need program whereby health care providers are required to apply for permission to build or expand facilities. Twenty-four of those programs require certificates of need specifically for neonatal intensive care services.19 Although certificate-of-need and other regulatory approaches do not offer a panacea for ensuring regionalization of services, it is notable that Pennsylvania is the only Northeast region state with no certificate-of-need program. (The New Hampshire program does not apply specifically to NICU services, but it does apply to medical equipment purchases of more than $400 000.) The effects of state regulatory practices are illustrated by a recent case study in Massachusetts, a state with strict certificate-of-need regulation of perinatal services. Flaherty showed that the proportion of very-low-birthweight births in NICU hospitals rose from 35% to 86% between 1975 and 1994, with a net change of only 3 new NICUs. This was accompanied by a progressive fall in neonatal mortality,20 and currently Massachusetts has the lowest infant mortality rate in the United States.21

Investigating the myriad local factors that could lead to a proliferation of small NICUs, and consequently to the deregionalization of perinatal services, is beyond the scope of this study. These are likely to include local politics, citizen pressures, hospital ownership, the history of cooperation among health care providers, the current competitive environment, and a desire by the expanding pool of neonatologists to have appropriate practice environments. Further case studies such as the one cited earlier for Hartford10 and the multicity case studies by Allison-Cook et al.22 will be needed at the local level to tease out these various factors. In particular, a study of the factors leading to a fragmentation of perinatal services in Philadelphia might lend insights for other communities. It is possible that such forces also affect, in a similar manner, other important specialty services, such as cardiac care, that benefit from regionalization.23

Currently, policymakers are undergoing an intense process of considering ways to regulate fairly the quality of health care. As part of this process, the issues surrounding regionalization are an important area for examination and possible intervention. The results of this study suggest that health officials should examine why the number of small NICUs has expanded in some cities, counter to the long-standing professional acceptance of the value of regionalization.


   Acknowledgments
 
The research was supported by the Robert Wood Johnson Foundation through its grant to the Center for Studying Health System Change.

The authors acknowledge the help of Mei-Ling Mason and Royston McNeil, who constructed the data files and prepared the tables.


   Footnotes
 
E. M. Howell designed the study and directed the research, including overseeing the data analysis and writing parts of the manuscript. D. Richardson assisted in synthesizing the literature, interpreting results, suggesting analyses, and writing sections of the manuscript. P. Ginsburg played a substantive review role, providing suggestions about data, methods, and the direction of the analysis. B. Foot performed much of the data analysis and wrote sections of the manuscript.

Peer Reviewed

Accepted for publication December 13, 2000.


   References
TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 References
 
1. Guidelines for Perinatal Care. Elk Grove Village, Ill: American Academy of Pediatrics; 1997.

2. McCormick MC, Richardson DK. Access to neonatal intensive care. Future of Children. 1995;5:162–175.[Medline]

3. Mayfield JA, Rosenblatt RA, Baldwin LM, Chu J, Logerfo JP. The relation of obstetrical volume and nursery level to perinatal mortality. Am J Public Health. 1990;80:819–823.[Abstract/Free Full Text]

4. Phibbs CS, Bronstein JM, Buxton E, Phibbs RH. The effects of patient volume and level of care at the hospital of birth on neonatal mortality. JAMA. 1996;276:1054–1059.[Abstract/Free Full Text]

5. Horbar JD, Badger GJ, Lewit EM, Rogowski J, Shiono PH. Hospital and patient characteristics associated with variation in 28-day mortality rates for very low birth weight infants. Vermont Oxford Network. Pediatrics. 1997;99:149–156.[Abstract/Free Full Text]

6. Lucey J. Why we should regionalize perinatal care. Pediatrics. 1973;52:488–491.[Abstract/Free Full Text]

7. Merkatz IR, Johnson K. Regionalization of perinatal care for the United States. Clin Perinatol. 1976;3:271–276.[Medline]

8. Committee on Perinatal Health. Toward Improving the Outcome of Pregnancy: Recommendations for the Regional Development of Maternal and Perinatal Health Services. White Plains, NY: National Foundation–March of Dimes; 1976.

9. Schwartz RM. Supply and demand for neonatal intensive care: trends and implications. J Perinatol. 1996;16:483–489.[Medline]

10. Richardson DK, Reed K, Cutler JC, et al. Perinatal regionalization versus hospital competition: the Hartford example. Pediatrics. 1995;96:417–423.[Abstract/Free Full Text]

11. Menard MK, Liu Q, Holgren EA, Sappenfield WM. Neonatal mortality for very low birth weight deliveries in South Carolina by level of hospital perinatal service. Am J Obstet Gynecol. 1998;179:374–381.[Medline]

12. Yeast JD, Poskin M. Stockbauer JW, Shaffer S. Changing patterns in regionalization of perinatal care and the impact on neonatal mortality. Am J Obstet Gynecol. 1998;178:131–135.[Medline]

13. American Hospital Association. Annual survey of hospitals database for years 1980, 1990, and 1995. Available at: www.ahadata.com. Accessed August 22, 2001.

14. Atlas Select, Version 3.02. Santa Clara, Calif: Strategic Mapping; 1996.

15. The InterStudy Competitive Edge 6.1 Part III: Regional Market Analysis. St Paul, Minn: InterStudy; 1996.

16. American Board of Medical Specialties. The Official ABMS Directory of Board Certified Medical Specialist. [book on CD-ROM]. New Providence, NJ: Reed Reference Publishing; 1996.

17. Stevenson DK, Wright LL, Lemons JA, et al. Very low birthweight outcomes of the National Institute of Child Health and Human Development Neonatal Research Network. Am J Obstet Gynecol. 1998;179:1632–1639.[Medline]

18. Hack M, Horbar JD, Malloy MH, et al. Very low birthweight outcomes of the National Institute of Child Health and Human Development Neonatal Network. Pediatrics. 1991;87:587–597.[Abstract/Free Full Text]

19. Moore DJ Jr. Certificate of need: gone in many states but not dead yet. Mod Healthcare. 1997;27:32–36.

20. Flaherty K. Access to Tertiary Care Maternity Hospitals and Neonatal Mortality Among High Risk Infants in Massachusett. [dissertation]. Boston, Mass: Harvard School of Public Health; 1998.

21. Health, United States, 1999. Hyattsville, Md: National Center for Health Statistics; 1999.

22. Allison-Cook S, Schwartz RM, Gagnon DE. The Perinatal Partnership: An Approach to Organizing Care in the 1990s. Providence, RI: National Perinatal Information Center; 1988.

23. Farley DE, Ozminkowski RJ. Volume-outcome relationships in hospital mortality: the effect of changes in volume over time. Med Care. 1992;30:77–94.[Medline]




This article has been cited by other articles:


Home page
 PediatricsHome page
P. Van Reempts, L. Gortner, D. Milligan, M. Cuttini, S. Petrou, R. Agostino, D. Field, L. den Ouden, K. Borch, J. Mazela, et al.
Characteristics of Neonatal Units That Care for Very Preterm Infants in Europe: Results From the MOSAIC Study
Pediatrics, October 1, 2007; 120(4): e815 - e825.
[Abstract] [Full Text] [PDF]

Home page
 NEJMHome page
C. S. Phibbs, L. C. Baker, A. B. Caughey, B. Danielsen, S. K. Schmitt, and R. H. Phibbs
Level and Volume of Neonatal Intensive Care and Mortality in Very-Low-Birth-Weight Infants
N. Engl. J. Med., May 24, 2007; 356(21): 2165 - 2175.
[Abstract] [Full Text] [PDF]

Home page
 PediatricsHome page
C. A. Haberland, C. S. Phibbs, and L. C. Baker
Effect of Opening Midlevel Neonatal Intensive Care Units on the Location of Low Birth Weight Births in California
Pediatrics, December 1, 2006; 118(6): e1667 - e1679.
[Abstract] [Full Text] [PDF]

Home page
 PediatricsHome page
B. Warner, M. J. Musial, T. Chenier, and E. Donovan
The Effect of Birth Hospital Type on the Outcome of Very Low Birth Weight Infants
Pediatrics, January 1, 2004; 113(1): 35 - 41.
[Abstract] [Full Text] [PDF]

Home page
 Journal of Health Politics, Policy and LawHome page
B. Friedman, K. J. Devers, C. A. Steiner, and S. Fox
The Use of Expensive Health Technologies in the Era of Managed Care: The Remarkable Case of Neonatal Intensive Care
Journal of Health Politics Policy and Law, June 1, 2002; 27(3): 441 - 464.
[Abstract] [PDF]

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow purchase articles
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Right arrow Get other permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (9)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Howell, E. M.
Right arrow Articles by Foot, B.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Howell, E. M.
Right arrow Articles by Foot, B.

HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Copyright © 2002 by the American Public Health Association