|
|
||||||||
SCALING UP PROMISING INTERVENTIONS |
Denise Hallfors, Paul H. Brodish, Hyunsan Cho, and Allan Steckler are with the Pacific Institute for Research and Evaluation, Chapel Hill, NC. Allan Steckler is also with the Department of Health Behavior and Health Education, School of Public Health, University of North Carolina at Chapel Hill. Shereen Khatapoush is with the Daniel Bryant Youth and Family Treatment Center, Council on Alcoholism and Drug Abuse, Santa Barbara, Calif. Victoria Sanchez is with the School of Nursing, University of North Carolina at Chapel Hill.
Correspondence: Requests for reprints should be sent to Denise Hallfors, PhD, 1516 E Franklin St, Suite 200, Chapel Hill, NC 27514 (e-mail: hallfors{at}pire.org).
| ABSTRACT |
|---|
|
|
|---|
Objectives. We evaluated the feasibility of a population-based approach to preventing adolescent suicide.
Methods. A total of 1323 students in 10 high schools completed the Suicide Risk Screen. Screening results, student follow-up, staff feedback, and school responses were assessed.
Results. Overall, 29% of the participants were rated as at risk of suicide. As a result of this overwhelming percentage, school staffs chose to discontinue the screening after 2 semesters. In further analyses, about half of the students identified were deemed at high risk on the basis of high levels of depression, suicidal ideation, or suicidal behavior. Priority rankings evidenced good construct validity on correlates such as drug use, hopelessness, and perceived family support.
Conclusions. A simpler, more specific screening instrument than the Suicide Risk Screen would identify approximately 11% of urban high school youths for assessment, offering high school officials an important opportunity to identify young people at the greatest levels of need and to target scarce health resources. Our experiences from this study show that lack of feasibility testing greatly contributes to the gap between science and practice.
| INTRODUCTION |
|---|
|
|
|---|
Suicide is a complex endpoint on a continuum ranging from ideation to gestures, plans, attempts, and completions.7 According to data from 2003, during that year 17% of US high school students had seriously considered attempting suicide, and nearly 9% had attempted suicide at least once in the preceding 12 months.8 Students in 9th (10%) and 10th (9%) grade were more likely than those in 11th (7%) and 12th (6%) grade to have attempted suicide in the past year.8 The strongest risk factors for youth suicide are depression, substance abuse, aggressive or disruptive behaviors, and previous suicide attempts.6,9,10 Among girls, the most important risk factor is major depression (increasing risk by up to 20-fold), followed by a previous suicide attempt; among boys, previous attempt is the most important predictor (increasing risk by more than 30-fold), followed by depression, alcohol or drug abuse, and disruptive behavior.11,12
Current data on suicide risk factors among ethnic minority youths are scarce. The major source of such data, the Centers for Disease Control and Preventions biennial Youth Risk Behavior Surveillance Survey, indicates that White and Hispanic students are more likely than are Black students to consider attempting suicide or to have a plan, and Hispanic students are more likely than are White or Black students to have attempted suicide.8 Female Hispanics are particularly vulnerable to suicidal ideation and attempts,13 with the risk rate among this group estimated at 17.8%.14
Nearly half of depressed adolescents report being preoccupied with death and suicide.6 Although there is a strong association between suicidal ideation and depression, suicidal ideation may occur in the absence of depression.15 Adolescent suicide is often precipitated by a psychosocial stressor such as recent loss, rejection, or a disciplinary crisis,16 although such events are common in this age group. In fact, only a fraction of adolescents among whom these risk factors are present actually commit suicide. Strong social support networks and peer relationships are protective.17,18
An effective population-based strategy to prevent adolescent suicide should include a school-based approach, given that such an approach is the most efficient way to reach large numbers of young people. However, in a systematic review of curriculum-based adolescent suicide prevention programs, Ploeg et al.19 found insufficient evidence to support these programs; moreover, they noted some indication of harmful effects, particularly among certain subgroups. Other research has shown that boys exposed to a curriculum-based suicide prevention program were more likely than boys not exposed to such a program to consider suicide as a possible solution to their problems and that suicide attempters find talking about suicide in class upsetting and believe it can result in some adolescents being more likely to attempt suicide.20,21
In contrast, there is considerable support for direct case-finding strategies that consist of confidential surveys followed by more intensive assessments of young people shown to be at risk for suicide.16,22 Only a small number of empirical studies have assessed the effectiveness or feasibility of such an approach in schools, however. The few studies that have been conducted suggest that suicide screenings in schools may face significant resistance. Surveys of both high school principals and school psychologists reveal that they view schoolwide student screening programs as less acceptable than curriculum-based or staff in-service programs.23,24 Insufficient staffing and budgets, scheduling issues, legal concerns, and potential negative responses of administrators, parents, and students are potential "real-world" barriers to program adoption and implementation.25
In addition to demonstrating strong psychometric validity, a worthwhile screening instrument must be adopted, implemented, and maintained in field settings.26 We evaluated the feasibility of an adolescent suicide screening measure designed for use in public schools. Although clinical guidelines have advocated case finding through school-based screening,9,16 we know of no such field test of feasibility reported in the literature. We report findings from our attempt to implement a well-known screening instrument at 10 high schools in 2 large urban districts. We also provide recommendations for further developing the instrument so as to improve its utility in school settings.
| METHOD |
|---|
|
|
|---|
Students were participants in a randomized, controlled trial assessing the effectiveness of Reconnecting Youth, a semester-long, indicated (i.e., targeting young people who are already experimenting with drugs or who exhibit other risk-related behaviors, as opposed to universal programs targeting all youths) prevention program taken as an elective. The curriculum integrates life skills training modules in an interactive peer group context designed to enhance high-risk adolescents personal (e.g., goal setting and problem solving) and social (e.g., positive social interaction) protective skills.27 Because these young people tend to have problems in multiple areas, Reconnecting Youth seeks to develop skills related to improved school performance, decreased substance use, and improved mood management.27,28
All Reconnecting Youth study participants were included in the suicide screening. Students were identified as being at high risk if (1) they were in both the upper 25% distribution in terms of absences and the lower 50% distribution in terms of grade point average or (2) they had been referred by a teacher. A random sample of students meeting the criteria for high-risk classification were invited to take part in the study in spring and fall 2002. With the consent of their parents, those who agreed to participate completed a baseline questionnaire. Of the 1995 high-risk students eligible to be included across all schools, 930 (47%) completed the questionnaire. These high-risk participants had significantly higher mean grade point averages (1.51 vs 1.33) and rates of attendance (86% vs 84%) than did the overall pool of high-risk students; there were no differences in gender or race/ethnicity.
Subsequently, a sample of "typical" students was randomly selected to establish "normative behaviors" in the study schools and districts. Of the 608 "typical" students selected, 393 (65%) completed the survey. There were no significant differences between the "typical" students who took part in the study and the overall pool of "typical" students.
Measures
The High School Questionnaire (HSQ)27,29 includes items assessing school deviance and school connectedness; peer bonding; family support; emotional issues such as self-esteem, stress, anxiety, hopelessness, and personal control; high-risk behaviors; substance use; suicide; and demographic variables such as age, gender, grade, ethnicity, and family structure. HSQ multi-item scales have demonstrated acceptable reliability and validity in previous studies.29,30 In this study, the HSQ was adapted to an audio-computer-assisted self-interviewing format intended to assist students with limited reading ability, decrease missing data and data processing times,31 and improve veracity in terms of reporting sensitive information.32 Only data collected at baseline were used in the present analyses.
The Suicide Risk Screen (SRS),33 a screening instrument embedded in the HSQ, focuses on sets of rank-ordered criteria based on confirmed suicide risk factors (Table 1
). The SRS is unique in assessing the full range of factors found to predict suicide in psychological autopsy studies.34 The developers have established preliminary construct, discriminant, and predictive validity in independent samples.35 Validity against clinician rating scales and other standard instruments has been reported in a diverse sample of high-risk youths, with sensitivity rates ranging from 87% to 100% and specificity rates from 54% to 60%.33
|
Feasibility Evaluation
Initially, we evaluated feasibility by examining the percentages of young people rated as at risk of suicide. We then conducted bivariate analyses to examine associations between suicide risk and demographic factors. Subsequently, we documented the availability and performance of school personnel in follow-up interviews of young people classified as at risk and solicited staff and school feedback to assess support for continuing implementation.
Additional Analyses
We conducted additional analyses to determine whether students rated as at risk could be further classified according to degree of risk. Using the available literature as a guide,6,12,16 we developed 5 mutually exclusive risk level categories: (1) highest (past year suicide attempt in combination with a high level of current suicidal ideation or serious depression), (2) very high (past year suicide attempt), (3) high (no past year suicide attempt but high current suicidal ideation or serious depression with any ideation), (4) moderate (other SRS criteria met), and (5) low (SRS criteria not met). We examined risk factor levels according to demographic characteristics, screening items, and additional questionnaire items related to suicide (belief that suicide is an acceptable personal option, hopelessness, drug use, school connectedness, and family support). Finally, we compared rates of follow-up according to risk level.
| RESULTS |
|---|
|
|
|---|
Follow-Up Interviews
Of the 389 students rated as at risk, 120 (31%) did not complete a follow-up interview. The protocol directed school staff to make at least 3 attempts to reach students at school or home. Seventy-three students were not located after the requisite number of attempts; no attempt was made to interview the remaining 43 students. Schools varied greatly in terms of quality and timing of follow-up interviews at each of the sites. Protocol compliance was best when the designated contact or team conducted all of the interviews. Compliance was poorest when the primary contact assigned interviews to the students academic counselors, a common deviation from the protocol. No school in either area was able to complete all of the interviews within the 1-week time frame.
At 3 site A schools, the primary contact was a masters-level social worker or counselor who personally completed all follow-up interviews within 2 to 4 weeks of the initial screening. This individual also personally contacted all parents through home visits, school meetings, or telephone conferences. At a fourth school, no follow-ups were conducted during the first semester, but counselors completed most as assigned during the second semester. At a fifth school, no follow-up interviews were conducted. Rather, the assistant principal sent a letter to the parents of all youths rated as at risk, notifying them about the availability of mental health services.
Site B had a federal grant to establish school and community partnerships to promote student health. Of the sites 5 schools, 4 had grant-funded wellness coordinators (who served as the primary contacts in this study), a community health outreach worker, a half-time substance abuse counselor, and a half-time mental health counselor. All of the sites schools had a nurse and academic counselors. These staff members participated in follow-up interviews in varying combinations in the different schools. The fifth school had a school-based clinic staffed by doctors, nurses, therapists, and health educators, all of whom conducted follow-up interviews.
Although site B schools appeared to have adequate staff, the numbers of students identified for follow-up overwhelmed school personnel. Two schools used a designated team to assess all identified students. The remaining schools required persistent monitoring and reminders, and one school ultimately needed staffing assistance to complete the follow-ups.
Staff Feedback
Even some of the most ardent supporters of the screening process at site A questioned the feasibility of conducting follow-up interviews given the numbers of students identified as at risk. An administrator at the school that sent letters to parents rather than conducting student interviews reported that counselors there had not believed that some of the students identified were really at risk, and they were concerned about unduly alarming students and parents. Another administrator raised concerns about liability if an identified student who had not been followed up attempted suicide.
Personnel at each of the site B schools wanted to discontinue screening at the end of the second semester. Because of a heavy regular workload, they considered it unrealistic to assess 10 to 25 students during a given week. Staff did not perceive great value in the screening, in that most of the students assessed were found to be at low to moderate risk and were difficult to locate as a result of truancy. Two comments from school staff members provide insights into their perspectives as well as those of others:
The process is totally unrealistic given the numbers we are getting. I really believe the people who should be doing the assessment are the counselors, since they are responsible for the students, but . . . they already are overloaded with 600 students apiece. They cannot drop everything to follow up on the numbers we are getting. . . . Although we have wellness staff, they have students on their caseloads that they need to see. It is getting into the holiday season, which can be very stressful for students; staff needs to be available to help them prepare for the holidays. . . . Out of all the [assessments] we have done, we have only had one that was serious enough to get [the student] into counseling right away.I spoke with [the district coordinator] this afternoon and she thinks we need to call another meeting to discuss pulling the suicide questions [from the survey]. The school staff is "totally overwhelmed" and shes meeting with some resistance as shes giving them the lists of students who are screening in during Q2 [the survey] this week. Its not so much that they dont want to do it . . . as it is feeling like they cant. Theyve just finished dealing with all the kids who screened in during recruitment and are not happy about having to deal with more kids now, and are worried about the ever-growing list of names.
At the end of the 2 semesters, both school districts decided that they no longer wanted to participate in the suicide screening, and it was dropped from the HSQ and the study.
Additional Analyses
Given staff feedback, we conducted additional analyses to determine whether students could be prioritized so that counselors could assess those in greatest need first. Applying the study criteria (as outlined in the Methods section) to students rated as at risk, we found that 41 (11%) were in the highest risk factor category, 81 (20%) were in the very high category, 76 (20%) were in the high category, and 191 (49%) were in the moderate category (Table 2
). A comparison of the 2 study groups (high risk and "typical") revealed that high-risk students exhibited greater risk, with twice the percentage of these students falling in the highest risk category.
|
|
| DISCUSSION |
|---|
|
|
|---|
Although our analyses support prioritization of students rated as at risk of suicide, the SRS developers have argued that a high level of tolerance of false positives is necessary because of the seriousness of missing a single suicidal individual.33 Assessments of screening instruments involve tests of their ability to predict riskthat is, their positive predictive value (PPV)but in the case of suicide, base rates affect PPV.36 The PPV for Thompson and Eggerts high-risk sample (n = 576) was 37% (i.e., roughly one of each 3 students rated as at risk according to the SRS was deemed at risk by clinicians), for example, but this assumed a 22% base rate.33 In contrast, the developers of the Columbia Suicide Screen assumed base rates of 4% to 10% in calculating PPV.34 Using published SRS data,33 we recalculated PPVs with base rates of 9% (Youth Risk Behavior Surveillance Survey suicide attempt rate) and 11% (high-risk suicide attempt rate from the present study). This analysis yielded PPVs of 18% and 21%, respectively, corroborating the feedback from school staff members.
We believe that the SRSs low specificity results in too many false positives for the instrument to be practical in schools. We recommend testing a simplified instrument that identifies only students who have attempted suicide in the past year, who are at high current levels of suicidal ideation, or who are at high current levels of depression and exhibit any degree of suicidal ideation. Our analyses showed a dramatic jump in most risk and protective factors between students at moderate and at high risk.
Because high-risk youths were oversampled in this study, more accurate estimates can be derived through weighting of the data. (We adjusted the data by weighting as follows: We divided the desired proportion [0.8] by the actual proportion [0.3] to obtain the weight for the "typical" group [2.67] and engaged in a similar process to obtain the weight for the high-risk group [0.2/0.7 = 0.286].) High-risk youths actually represented about 20%, rather than 70%, of all students in the sample schools. Assuming 80% "typical" and 20% high-risk students, 11% of students would be expected to be classified in the high, very high, or highest group (4%, 5%, and 2%, respectively), and 12% would be expected to be classified in the moderate group. Thus, in a school with 1000 students, the SRS would indicate 23%, or 230 students, as being at risk; limiting the screening to the high, very high, and highest groups would decrease the number to 110. Even this reduced number, however, would require schools to systematically screen students over the full school year (perhaps 100 students per month) so as not to overwhelm assessment staff.
We found other problems in addition to the screening instrument itself. School personnel were reluctant to participate in training, which was offered but often declined. Most believed they had sufficient professional training, but, on the basis of our experience, we suggest that training on a standard assessment protocol be provided to all involved staff. Recent budget crises37 and the increased academic accountability standards of the No Child Left Behind legislation (Pub L No. 107110), however, may leave schools unable to take on a screening program alone. An alternative might be for schools to partner with local health departments, adolescent health clinics, or mental health agencies to conduct periodic screenings.38
Another problem was school readiness. Appropriate personnel were available in most of our sample schools to conduct follow-up interviews, and most supported and expressed great interest in doing so. Nevertheless, not all staff and administrators were enthusiastic. Diffusion theory39 suggests that although some organizations embrace innovation, others prefer to wait and observe as others attempt new programs, while still others prefer to wait a significant amount of time before changing their ways. Excessive staff turnover and changes in administrative personnel can further hamper successful implementation. In each of the 2 districts, we found that only a few schools were able to comply with the protocols and act as partners in evaluating the program. On the basis of our experience, we recommend identifying schools that are both stable and innovative and limiting feasibility research to such schools. After sufficient testing and refinement, the program can then be tested in other schools.
Several limitations of this study should be noted. We took advantage of the opportunity afforded by a large evaluation studyone that involved the use of an existing questionnaire with an embedded suicide prevention screening instrumentto test the feasibility of a screening program. All of the study schools were located in 2 large urban districts. The researchers, rather than the schools themselves, collected and analyzed the screening data. The study design was observational, and there was no attempt to test predictive validity. The researchers subsequently analyzed the data according to hypothesized, literature-based levels of risk, but further rigorous testing of the recommended revised instrument is required. Although other promising adolescent suicide screening instruments are available, a recent comprehensive review showed that thorough, systematic evaluations of properties and utility are generally lacking.40
Our experience indicates that feasibility testing is essential to narrow the gap between science and practice. We wish to underscore the seriousness of the public health problem of suicide and the important opportunity to identify young people with serious, suicide-related mental health problems through school-based programs. Students exhibiting high levels of suicide risk factors are also more likely to have health problems related to drug abuse and risky sexual behavior.41 Arguably, students in this group are most in need of scarce school-based health resources, and identifying them for services should be a high priority. Nevertheless, additional population-based studies are needed to confirm whether this approach actually leads to improved health outcomes and reductions in suicide behavior and depression among high-school populations.
| Acknowledgments |
|---|
We gratefully acknowledge the hard work of the school staff responsible for assessing students and the cooperation of the administrators and teachers in the 2 study school districts.
Human Participant Protection
This study was approved by the institutional review board of the Pacific Institute for Research and Evaluation. Informed consent was obtained from all study participants.
| Footnotes |
|---|
Contributors
D. Hallfors originated the study, wrote the initial outline, and made all final revisions. P. H. Brodish wrote an initial draft, synthesized the data presented in the tables, and helped to coordinate revisions to the article. S. Khatapoush and V. Sanchez were the on-site research coordinators and helped to develop and critically revise the article. H. Cho conducted the suicide screening and additional data analyses and edited drafts of the article. A. Steckler contributed to the conception and design of the article and helped to critically revise drafts. All of the authors helped to conceptualize ideas and interpret findings.
Accepted for publication December 24, 2004.
| References |
|---|
|
|
|---|
2. Kochanek KD, Smith BL. Deaths: preliminary data for 2002. Natl Vital Stat Rep. February 11, 2004;52(13).
3. Freid V, Prager K, MacKay A, Xia H. Chartbook on Trends in the Health of Americans: Health, United States, 2003. Hyattsville, Md: National Center for Health Statistics; 2003.
4. Health, United States, 2000, With Adolescent Health Chart Book. Hyattsville, Md: National Center for Health Statistics; 2000.
5. MacKay A, Fingerhut L, Duran C. Adolescent Health Chartbook. Hyattsville, Md: National Center for Health Statistics; 2000.
6. Lewinsohn P, Rohde P, Seeley J. Adolescent suicidal ideation and attempts: prevalence, risk factors, and clinical implications. Clin Psychol. 1996;3:2546.[ISI]
7. Maris RW. Suicide. Lancet. 2002;360:319326.[CrossRef][ISI][Medline]
8. Grunbaum JA, Kann L, Kinchen SA, et al. Youth risk behavior surveillanceUnited States, 2003. MMWR Morb Mortal Wkly Rep. 2004;53(SS2):513.[Medline]
9. Gould MS, Greenberg T, Velting DM, Shaffer D. Youth suicide risk and preventive interventions: a review of the past 10 years. J Am Acad Child Adolesc Psychiatry. 2003;42:386405.[ISI][Medline]
10. Petronis KR, Samuels JF, Moscicki EK, Anthony JC. An epidemiologic investigation of potential risk factors for suicide attempts. Soc Psychiatry Psychiatr Epidemiol. 1990;25:193199.[ISI][Medline]
11. Brent DA, Perper J, Moritz G, Baugher M, Allman C. Suicide in adolescents with no apparent psychopathology. J Am Acad Child Adolesc Psychiatry. 1993;32: 494500.[ISI][Medline]
12. Shaffer D, Gould MS, Fisher P, et al. Psychiatric diagnosis in child and adolescent suicide. Arch Gen Psychiatry. 1996;53:339348.[Abstract]
13. Canino G, Roberts R. Suicidal behavior among Latino youth. Suicide Life Threat Behav. 2001;31(suppl): 122131.[Medline]
14. Substance Abuse and Mental Health Services Administration. Summary of Findings From the 2000 National Household Survey on Drug Abuse. Rockville, Md: US Dept of Health and Human Services; 2001. DHHS publication SMA 01-3549.
15. King RA, Schwab-Stone M, Flisher AJ, et al. Psychosocial and risk behavior correlates of youth suicide attempts and suicidal ideation. J Am Acad Child Adolesc Psychiatry. 2001;40:837846.[CrossRef][ISI][Medline]
16. Shaffer D, Pfeffer CR, Work Group on Quality Issues. Practice parameter for the assessment and treatment of children and adolescents with suicidal behavior. J Am Acad Child Adolesc Psychiatry. 2001;40(suppl 7): 24S51S.[CrossRef][ISI][Medline]
17. Weller EB, Young KM, Rohrbaugh AH, Weller RA. Overview and assessment of the suicidal child. Depression Anxiety. 2001;14:157163.[CrossRef][ISI][Medline]
18. Bearman PS, Moody J. Suicide and friendships among American adolescents. Am J Public Health. 2004;94:8995.
19. Ploeg J, Ciliska D, Dobbins M, Hayward S, Thomas H, Underwood J. A systematic overview of adolescent suicide prevention programs. Can J Public Health. 1996;87:319324.[ISI][Medline]
20. Shaffer D, Garland A, Vieland V, Underwood M, Busner C. The impact of curriculum-based suicide prevention programs for teenagers. J Am Acad Child Adolesc Psychiatry. 1991;30:588596.[ISI][Medline]
21. Shaffer D, Vieland V, Garland A, Rojas M, Underwood M, Busner C. Adolescent suicide attempters: response to suicide-prevention programs. JAMA. 1990;264:31513155.[Abstract]
22. Shaffer D, Craft L. Methods of adolescent suicide prevention. J Clin Psychiatry. 1999;60(suppl 2):7074.[Medline]
23. Miller DN, Eckert TL, DuPaul GJ, White GP. Adolescent suicide prevention: acceptability of school-based programs among secondary school principals. Suicide Life Threat Behav. 1999;29:7285.[ISI][Medline]
24. Eckert T, Miller DN, DuPaul GJ, Riley-Tillman T. Adolescent suicide prevention: school psychologists acceptability of school-based programs. Sch Psychol Rev. 2003;32:5776.
25. Hayden DC, Lauer P. Prevalence of suicide programs in schools and roadblocks to implementation. Suicide Life Threat Behav. 2000;30:239251.[ISI][Medline]
26. Glasgow RE, Lichtenstein E, Marcus AC. Why dont we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93: 12611267.
27. Eggert LL, Thompson EA, Herting JR, Nicholas LJ. Prevention research program: reconnecting at-risk youth. Issues Ment Health Nurs. 1994;15:107135.[Medline]
28. Eggert LL, Thompson EA, Herting JR, Nicholas LJ. Reducing suicide potential among high-risk youth: tests of a school-based prevention program. Suicide Life Threat Behav. 1995;25:276296.[ISI][Medline]
29. Eggert LL, Thompson EA, Herting JR, Nicholas LJ, Dicker BG. Preventing adolescent drug abuse and high-school dropout through an intensive school-based social network development program. Am J Health Promotion. 1994;8:202215.[Medline]
30. Eggert LL, Herting JR, Thompson EA. Measurement Document and Questionnaire Item Identification for High School Questionnaire, Reconnecting At-Risk Youth NIDA Project. Seattle, Wash: Dept of Psychosocial Nursing, University of Washington; 1998.
31. Hallfors D, Watson K, Khatapoush S, Kadushin K, Saxe L. A comparison of paper vs. computer assisted self interview for school alcohol, tobacco, and other drug surveys. Eval Program Plann. 2000;23:149155.[Medline]
32. Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, Sonenstein FL. Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science. 1998;280:867873.
33. Thompson EA, Eggert LL. Using the Suicide Risk Screen to identify suicidal adolescents among potential high-school dropouts. J Am Acad Child Adolesc Psychiatry. 1999;38:15061514.[CrossRef][ISI][Medline]
34. Shaffer D, Scott M, Wilcox H, et al. The Columbia Suicide Screen: validity and reliability of a screen for youth suicide and depression. J Am Acad Child Adolesc Psychiatry. 2004;43:7179.[CrossRef][ISI][Medline]
35. Eggert LL, Thompson EA, Herting JR. A measure of adolescent potential for suicide (MAPS): development and preliminary findings. Suicide Life Threat Behav. 1994;24:359381.[ISI][Medline]
36. Bennett KJ. Screening for externalizing behavior problems. J Am Acad Child Adolesc Psychiatry. 2000; 39:13411342.[ISI][Medline]
37. National Public Radio. Analysis: tough choices in state budgeting on education. Talk of the Nation. April 22, 2003.
38. Knox KL, Conwell Y, Caine ED. If suicide is a public health problem, what are we doing to prevent it? Am J Public Health. 2004;94:3745.
39. Rogers EM. Diffusion of Innovations. New York, NY: Simon & Schuster; 1995:252280.
40. Goldston D. Assessment of Suicidal Behaviors and Risk Among Children and Adolescents. Bethesda, Md: National Institute of Mental Health; 2000.
41. Hallfors D, Waller MW, Ford CA, Halpern CT, Brodish PH, Iritani B. Adolescent depression and suicide risk: association with sex and drug behavior. Am J Prev Med. 2004;27:224231.[ISI][Medline]
This article has been cited by other articles:
![]() |
A. E. Bonomi and K. Kelleher Dating Violence, Sexual Assault, and Suicide Attempts Among Minority Adolescents: Ending the Silence Arch Pediatr Adolesc Med, June 1, 2007; 161(6): 609 - 610. [Full Text] [PDF] |
||||
![]() |
M. J. Rotheram-Borus SCREENING FOR SUICIDE RISK Am J Public Health, August 1, 2006; 96(8): 1339 - 1340. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |