|
|
||||||||
RESEARCH AND PRACTICE |
Allison Kempe is with the Departments of Pediatrics and Preventive Medicine and Biometrics, University of Colorado Health Sciences Center, and the Childrens Outcomes Research Program, The Childrens Hospital, Denver, Colo. Brenda Beaty is with the Colorado Health Outcomes Program, University of Colorado Health Sciences Center, and the Childrens Outcomes Research Program, The Childrens Hospital. John Steiner is with the Department of General Internal Medicine and Colorado Health Outcomes Program, University of Colorado Health Sciences Center. Kellyn Pearson is with the Childrens Outcomes Research Program, The Childrens Hospital. N. Elaine Lowery, Matthew Daley, and Stephen Berman are with the Department of Pediatrics, University of Colorado Health Sciences Center, and the Childrens Outcomes Research Program, The Childrens Hospital. Lori Crane is with the Department of Preventive Medicine and Biometrics, University of Colorado Health Sciences Center, and the Childrens Outcomes Research Program, The Childrens Hospital.
Correspondence: Requests for reprints should be sent to Allison Kempe, MD, MPH, The Childrens Hospital, 1056 E 19th Ave, B032, Denver, CO 80218 (e-mail: kempe.allison{at}tchden.org).
| ABSTRACT |
|---|
|
|
|---|
Objectives. We assessed the distribution of immunization records among 3 health care delivery sectors and the impact of a regional immunization registry on "up to date" rates.
Methods. Immunization registry records in 2 regions were categorized as having originated in private practices, community health centers, or public health clinics. "Up to date" rates were calculated after we sequentially added immunization records from the 3 sectors.
Results. The percentage of children with immunizations documented in multiple sectors increased with age from 7 to 24 months, and children who were seen in multiple sectors were more likely to be up to date. There were relative increases in "up to date" rates of 50% for children aged 24 months.
Conclusions. The regional immunization registry is a powerful public health tool for increasing documented "up to date" rates and providing insights into patterns of immunization delivery.
| INTRODUCTION |
|---|
|
|
|---|
Record scatter is a significant barrier to accurate assessment of immunization "up to date" rates, especially in rural areas.1114 In fact, the problem of record scatter and the burden of trying to track immunizations are significant deterrents to rural primary care physicians participation in immunization delivery.11 The resultant practice of referring patients to public health clinics for immunization undermines the concept of the "medical home," defined by the American Academy of Pediatrics as "accessible, comprehensive, continuous and coordinated health care delivery by a provider that is known to the family."15
There has been limited previous assessment of the extent of the record scatter problem at a population level. In our study, we approximated a population-based analysis of record scatter in 2 rural regions of Colorado. Our specific objectives were to (1) assess the distribution of immunization records in 3 sectors of the health care delivery system (private practices, community health centers, and public health clinics that deliver immunizations but provide no other primary care), (2) assess the relationship between "up to date" rates and having records exclusively in any 1 sector, and (3) assess the impact of a regional immunization registry on documented "up to date" rates.
| METHODS |
|---|
|
|
|---|
|
Regional Immunization Registry
As part of the development of a regional registry, site-specific computerized immunization databases were established in each participating office in the 2 regions during 1999 and early 2000. To initiate the site-specific immunization databases, each private practice and community health center enumerated all children aged 0 to 30 months who had been seen for any reason at least once at that site, regardless of whether or not they had received immunizations at that site. Trained CRISP personnel used the enumeration data to abstract immunization information from the medical charts directly into the CRISP immunization software. For the public health clinics, all data from existing immunization tracking software were migrated into the site-specific computerized immunization database. Office staff were trained to create registry records for new patients and to enter all immunizationswhether recorded in an immunization history from other sites or given by the officeinto their immunization database in a timely manner.
Study Population
A data set of children aged 7 to 30 months on a specific cutoff date (January 31, 2000, in the San Luis Valley region and April 30, 2000, in the northeast region) was downloaded from each site-specific database for our analyses. To maximize the accuracy of these databases, trained CRISP personnel verified each site-specific data set by medical record abstraction. Medical records for all children from the registries in both regions were re-reviewed; if any immunizations were missing, they were added to the data sets, which were then merged to create a single record for each child. The study population, therefore, consisted of children who had any record at participating provider sites and who were aged 7 to 30 months on the cutoff dates in the 2 regions. The total sample (n = 1548) included 426 infants aged 7 to 11 months, 565 children aged 12 to 23 months, and 557 children aged 24 to 30 months.
Outcomes
The registry allowed us to ascribe documentation of records to specific sites, but we were not able to ascribe the site of delivery of immunizations. As a result, if records existed at a site, it could be assumed to be a site of care but could not be assumed to have provided that vaccination. The up-to-date criteria for each age group reflect the recommendations of the joint Advisory Committee on Immunization Practices/American Academy of Pediatrics/American Academy of Family Physicians harmonized schedule.17 An infant was considered to be up to date at 7 months if he or she had received at least 3 diphtheria-tetanus-pertussis (DTP), 2 polio, 2 hepatitis B, and 2 Haemophilus influenzae type B (Hib) immunizations. At 12 months, the requirement was 3 DTP, 2 polio, 2 hepatitis B, and 3 Hib immunizations; at 24 months it was 4 DTP, 3 polio, 1 measles-mumps-rubella, 3 hepatitis B, and 3 Hib immunizations.
Data Analysis
Each immunization delivery site and the immunizations recorded at those sites were assigned to 1 of the 3 health care delivery sectors (private practice, community health center, or public health clinic). Therefore, 3 separate but partially overlapping cohorts of children were defined, which permitted assessment of "up to date" rates from the perspective of a practitioner in each of the 3 sectors. To assess the benefit of "up to date" rates accrued by the registry, we created 3 data sets: (1) private-practice data only, (2) private-practice data plus community health center data, and (3) private-practice data plus community health center data plus public health clinic data for children who had any immunizations documented in the private-practice sector. Rates of up-to-date children were then calculated for each data set, and the rates of private practice alone and the rates of private practice plus the rates of all sectors were compared statistically with McNemars tests.
We conducted a similar analysis beginning with the cohort of children who were identified at community health centers and sequentially adding data from private practices and public health clinics. These additional analyses were performed because the cohorts who were defined by having records at private practices or by having records at community health centers, although overlapping, were different cohorts of children. Because the public health clinics in these regions do not provide comprehensive primary care, we did not repeat these analyses beginning with children who were identified by having records at public health clinics. Statistical comparisons of "up to date" rates between health care delivery sectors and between regions were performed with
2 analyses. All analyses were conducted with SAS software (SAS Institute Inc, Cary, NC).
| RESULTS |
|---|
|
|
|---|
Figure 1
shows the overall distribution of immunization records among the 3 health delivery sectors for children aged 7 and 24 months in both regions. In the San Luis Valley region, approximately one third of the infants younger than 1 year had immunization records exclusively in either the private-practice or public health clinic sectors, while only 22% had records exclusively in the community health center sector. The amount of overlap between sectors more than doubled from the 7-month to 24-month age groups (13% to 31%; P < 0.0001), with most of the increase occurring in the community health center sector (28% to 45%) and higher rates of overlap occurring between the private-practice and public health clinic sectors. In the northeast region, a higher percentage of infants younger than 1 year had records exclusively in the private-practice sector, with 12% having records only in the community health center sector and 16% having records only in the public health clinic sector. The overlap between the sectors increased among the older age groups (18% to 32%; P < 0.0001), with higher rates of overlap occurring between the private-practice and public health clinic sectors. Data for children aged 12 months in both regions showed similar trends, and values were intermediate between the other age groups (data not shown).
|
Relationship Between "Up to Date" Rates and Health Care Delivery Sector
As shown in Table 2
, among children aged 24 months in both regions, immunization rates were higher for children who had immunization records in multiple sectors than for those who were seen in only 1 health sector. In the northeast region, "up to date" rates were lowest for children who had records exclusively in the private-practice sector, while in the San Luis Valley region, the "up to date" rates were lowest for children who had records only in the community health center sector. The comparison between exclusively private practice (23% up to date) and more than 1 sector (64% up to date; P < 0.0001) for children aged 24 months in the San Luis Valley region was particularly striking, as was the falloff in "up to date" rates between the first and second years for children who had immunizations exclusively at private practices (56% vs 23%; P < 0.0001).
|
|
| DISCUSSION |
|---|
|
|
|---|
Our study expands on several previous studies that examined the potential benefit of consolidating records in immunization registries from the perspective of individual practices or the public health clinic versus private-practice sectors.1820 The results of our study, which included nearly complete data from all health delivery sectors in 2 regions, were similar to those previously reported for more limited populations, with increases in "up to date" rates in the range of 14% to 21% for children aged 24 months. The largest incremental increases in "up to date" rates resulted from the addition of records from the public health clinic sector for children older than 1 year who also had been seen at private practices.
Our data also provide insight into patterns of immunization delivery among the 3 health delivery sectors that have important public health policy implications. In both regions, there was a clear temporal trend for children to move into the public health clinic sector after the first year of age, and these children often received both private and public sector health care. Indeed, our data contradicted the perceptions of many of our participating providers in each of the health care sectors, who believed they provided almost all of the immunizations for the children who were seen at their practices. This perception was a major hurdle to overcome during the initial implementation of the CRISP registry and during the continued involvement of some providers in the 2 regions. At 24 months of age, about one third of the children who were seen in the public health clinic sector were seen exclusively in that sector, only slightly over half of the children who were seen in the private-practice sector were seen exclusively in that sector, and about two thirds of the children who were seen in the community health center sector were seen exclusively in that sector. Additionally, our data also demonstrate that children who received primary care in either the private-practice or community health center sectors were more likely to have documented up-to-date records if they also had records in multiple sectors. In these regions, children who utilized more than 1 sector appear to have better documentation and higher "up to date" rates.
These data illustrate the special challenges posed by immunization delivery in rural areas. From the point of view of rural private-practice physicians, most of whom are family physicians, it is difficult and expensive to maintain adequate supplies of a variety of vaccines, especially when the volume of children in their practice is low. Underinsurance for vaccines also is a common problem, because the parents of many children either do not have any coverage for vaccines through their insurance or they have to pay out-of-pocket when their deductible has not been met. Additionally, children often shift between public insurance programs and being uninsured because of seasonal changes in income and because of loss of continuous Medicaid eligibility after 12 months of age. Families must navigate the 3 immunization delivery systems as they experience shifts in their insurance status, financial status, deductible limits, access to primary care services, and transportation. As a result of all these factors, practitioners in rural areas frequently refer uninsured children, children with public insurance, and children with private insurance who have co-payments or deductibles to public health nursing services or clinics for immunizations.11,12
Our findings have important policy implications. Despite the success of the federal Vaccines for Children (VFC) program in increasing the numbers of vaccines administered in private practices nationally, our data suggest that public health nursing services and clinics continue to play a major role in immunizing children in rural areas. If the policy priority is to increase the involvement of privatepractice physicians in immunization delivery in rural areas, with the benefits of a single medical home, stronger financial incentives for participation in immunization delivery need to be instituted. At present, certain VFC policiesincluding inadequate administrative fees and regulations that prohibit use of VFC for underinsured children in private practicesundermine children who receive immunizations at their primary care site. As summarized in a recent publication, overall reimbursement is currently less than total delivery costs for the majority of vaccines among private practices in these rural areas.21 Liberalizing the regulations regarding use of VFC vaccine among underinsured children, providing an economic incentive for covering administration costs for physicians who participate in the VFC program, and increasing reimbursement for immunizations in general might arrest the observed trends to refer children to the public health sector for immunizations. Unless these needed changes are instituted, cutting federal support for public health immunization infrastructure is likely to result in lower immunization "up to date" rates in rural areas.
Our data also have implications for local health care delivery planning and policy. For example, in both regions, the registry identifies a portion of children who had records only in the public health clinic sector during their first year of life. In most cases, these children received shots but did not receive comprehensive preventive care from nursing services or immunization clinics. Our data indicate that by 2 years of age, many of these children appeared in the private-practice or community health center sectors, which suggests that they were accessing comprehensive primary care, although this care may have been significantly delayed. If it is linked to the public health department, the regional registry can serve an important role by identifying this at-risk group and by focusing local efforts to determine eligibility for Medicaid or the State Child Health Insurance Plan. Furthermore, the regional registry can promote early enrollment and access to primary care sites for this group of at-risk children.
Observed differences between the regions also raise interesting questions that are relevant to local policy makers. For example, why were children aged 24 months in the San Luis Valley region who had records exclusively in the private-practice sector less than half as likely to be up to date by available documentation when compared with children in the northeast region who had records exclusively in the private-practice sector? The regions differ substantially with respect to the structural organization of their community health centers and public health clinics, the sociodemographic characteristics of their populations, and their geography. Although our data do not supply definitive reasons for the observed regional differences in immunization documentation, they can focus the efforts of the communities to understanding the observed patterns and instigating positive change. This potential to use a regional registry to better understand patterns of health care delivery has not previously been explored.
Our findings have some important limitations. Although we attempted to approximate a population-based approach, our study did not include children aged 24 months who did not access any provider, who migrated into the area and had not yet accessed a provider, or the small percentage of children who accessed 2 practices that were not included because they provided too few immunizations. As previously noted, our registry was populated from medical records alone and did not include a concerted effect to enter hand-held records that were not part of the medical record at the time. Although the registry did markedly increase documented "up to date" rates, particularly for older infants, the overall "up to date" rates may be lower than those obtained if there was more aggressive collection of all historical data, including hand-held records.22 Finally, our data reflect regional patterns of documentation of immunizations, but they do not precisely map patterns of immunization delivery.
Regional immunization registries can help clinicians and public health officials increase immunization "up to date" rates by better tracking patients, by helping to target and carry out recall and reminder efforts, and by preventing overimmunization. Additionally, as this study shows, a regional registry also is a valuable public health tool that offers insight into immunization delivery and documentation on a population level. Data from a regional registry that demonstrate the extent of overlap in the delivery of preventive care at different ages can help persuade health care providers of the importance of a statewide registry. Also, patterns of immunization delivery within a region can reveal deficiencies in the delivery of care and can have important policy implications. Such data will be useful for increasing cooperation among different sectors of the health care delivery system within a community in focusing on the common goal of improving immunization delivery to children.
| Acknowledgments |
|---|
Human Participant Protection
No protocol was needed for this study.
| Footnotes |
|---|
Accepted for publication June 18, 2003.
| References |
|---|
|
|
|---|
2. Szilagyi PG, Bordley C, Vann JC, et al. Effect of patient reminder/recall interventions on immunization rates. JAMA.2000;284:18201827.
3. Linkins RW, Feikeme S. Immunization registries: the cornerstone of childhood immunization in the 21st century. Pediatr Ann.1998;27:349354.[ISI][Medline]
4. Lieu TA, Capra AM, Makol J, Black SB, Shinefield HR for the Immunization Message Study Group. Effectiveness and cost-effectiveness of letters, automated telephone messages, or both for underimmunized children in a health maintenance organization. Pediatrics.1998;101(4):e3.
5. Linkins RW, Dini EF, Watson G, Patriarca PA. A randomized trial of the effectiveness of computer-generated telephone messages in increasing immunization visits among preschool children. Arch Pediatr Adolesc Med.1994;148:908914.[Abstract]
6. Dini EF, Linkins RW, Sigafoos J. The impact of computer-generated messages on childhood immunization coverage. Am J Prev Med.2000;18(2):132139.[ISI][Medline]
7. Wilcox SA, Koepke CP, Levenson R, Thalheimer JC. Registry-driven, community-based immunization outreach: a randomized controlled trial. Am J Public Health.2001;91(9):15071511.
8. Soljak MA, Handford S. Early results from the Northland immunisation register. N Z Med J.1987;100:244246.[ISI][Medline]
9. Kempe A, Lowery NE, Pearson KA, et al. Immunization recall: effectiveness and barriers to success in an urban teaching clinic. J Pediatr.2001;139(5):630635.[ISI][Medline]
10. Daley MF, Steiner JF, Brayden RM, Xu S, Morrison S, Kempe A. Immunization registry-based recall for a new vaccine. Ambul Pediatr.2002;2(6):438443.[ISI][Medline]
11. Deutchman M, Brayden R, Siegel CD, Beaty B, Crane L. Childhood immunization in rural family and general practices: current practices, perceived barriers and strategies for improvement. Ambul Child Health.2000;6(3):181189.
12. Lowery E, Belansky ES, Siegel CD, et al. Rural childhood immunization: rates and demographic characteristics. J Fam Pract.1998;47:221225.[ISI][Medline]
13. Mainous AG III, Hueston WJ. Factors influencing the use of primary care physicians and public health departments for childhood immunization. J Ky Med Assoc.1993;91:394398.[Medline]
14. Hueston WJ, Mainous AG III, Palmer C. Delays in childhood immunizations in public and private settings. Arch Pediatr Adolesc Med.1994;148:470473.[Abstract]
15. American Academy of Pediatrics Policy Statement: the Medical Home. Pediatrics. 2002;110(1):184186.
16. US Dept of Commerce, Economics and Statistics, Administration, United States Census Bureau. Profiles of General Demographic Characteristics, 2000 Census of Population and Housing, Colorado. Available at: http://www.census.gov/prod/cen2000/dp1/2kh08.pdf. Accessed August 8, 2002.
17. American Academy of Pediatrics, Committee on Infectious Diseases. Recommended childhood immunization scheduleUnited States, JanuaryDecember, 2001. Pediatrics.2001;107:202204.
18. Kempe A, Steiner JF, Renfrew BL, Lowery E, Haas K, Berman S. How much does a regional immunization registry increase documented immunization rates at primary care sites in rural Colorado? Ambul Pediatr.2001;1(4):213216.[ISI][Medline]
19. Renfrew BL, Kempe A, Lowery NE, Chandramouli V, Steiner JF, Berman S. The impact of immunization record aggregation on up-to-date ratesimplications for immunization registries in rural areas. J Rural Health.2001;17(2):122126.[ISI][Medline]
20. Yawn BP, Edmonson L, Huber L, et al. The impact of a simulated immunization registry on perceived childhood immunization status. Am J Managed Care.1998;4:185192.[ISI][Medline]
21. Glazner JE, Steiner JF, Haas KJ, Renfrew B, Deutchman M, Berman S. Is reimbursement for childhood immunizations adequate? Evidence from two rural areas in Colorado. Public Health Rep.2001;116:219225.[ISI][Medline]
22. Rosenthal J, Rodewald L, Berman S, et al. High vaccination coverage in 4 health professional shortage areas (HPSA). Paper presented at: Pediatric Academic Societies and American Academy of Pediatrics Joint Meeting; May 1216, 2000; Boston, Mass.
This article has been cited by other articles:
![]() |
P. G. Szilagyi, C. M. Rand, J. McLaurin, L. Tan, M. Britto, A. Francis, E. Dunne, D. Rickert, and for the Working Group on Adolescent Vaccination in Delivering Adolescent Vaccinations in the Medical Home: A New Era? Pediatrics, January 1, 2008; 121(Supplement_1): S15 - S24. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Boom, A. C. Dragsbaek, and C. S. Nelson The Success of an Immunization Information System in the Wake of Hurricane Katrina Pediatrics, June 1, 2007; 119(6): 1213 - 1217. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. E. O'Connor, B. S. Matthews, and D. Gao Effect of open access scheduling on missed appointments, immunizations, and continuity of care for infant well-child care visits. Arch Pediatr Adolesc Med, September 1, 2006; 160(9): 889 - 893. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. F. Daley, L. A. Crane, V. Chandramouli, B. L. Beaty, J. Barrow, N. Allred, S. Berman, and A. Kempe Influenza Among Healthy Young Children: Changes in Parental Attitudes and Predictors of Immunization During the 2003 to 2004 Influenza Season Pediatrics, February 1, 2006; 117(2): e268 - e277. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. F. Daley, B. L. Beaty, J. Barrow, K. Pearson, L. A. Crane, S. Berman, and A. Kempe Missed Opportunities for Influenza Vaccination in Children With Chronic Medical Conditions Arch Pediatr Adolesc Med, October 1, 2005; 159(10): 986 - 991. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |