|
|
||||||||
RESEARCH AND PRACTICE |
Thomas W. Valente, Chih Ping Chou, and Mary Ann Pentz are with the Institute for Prevention Research, Department of Preventive Medicine, Keck School of Medicine, University of Southern California, Alhambra.
Correspondence: Requests for reprints should be sent to Thomas W. Valente, PhD, Keck School of Medicine, 1000 S Fremont Ave, Bldg A, Rm 5133, Alhambra CA 91803 (e-mail: tvalente{at}usc.edu).
| ABSTRACT |
|---|
|
|
|---|
Objectives. We examined the effect of community coalition network structure on the effectiveness of an intervention designed to accelerate the adoption of evidence-based substance abuse prevention programs.
Methods. At baseline, 24 cities were matched and randomly assigned to 3 conditions (control, satellite TV training, and training plus technical assistance). We surveyed 415 community leaders at baseline and 406 at 18-month follow-up about their attitudes and practices toward substance abuse prevention programs. Network structure was measured by asking leaders whom in their coalition they turned to for advice about prevention programs. The outcome was a scale with 4 subscales: coalition function, planning, achievement of benchmarks, and progress in prevention activities. We used multiple linear regression and path analysis to test hypotheses.
Results. Intervention had a significant effect on decreasing the density of coalition networks. The change in density subsequently increased adoption of evidence-based practices.
Conclusions. Optimal community network structures for the adoption of public health programs are unknown, but it should not be assumed that increasing network density or centralization are appropriate goals. Lower-density networks may be more efficient for organizing evidence-based prevention programs in communities.
| INTRODUCTION |
|---|
|
|
|---|
Several features of coalitions affect their performance.9 One factor is having a clearly articulated structure in which subcommittees make decisions and assign tasks.10,11 Other factors include professional representation (whether representatives from various professions are in the coalition), the variety of key stakeholder roles represented, participation (i.e., the frequency with which members attend meetings), and membership tenure.12,13 Notably missing in the study of coalition effectiveness is attention to the coalitions communication network, i.e., who is connected to whom and how those connections affect outcomes.1416 Social network analysis has shown how social network properties affect the adoption of health-related behaviors, such as smoking17,18 and contraceptive use.19,20 Network analysis also is used to study inter-organizational relations, because these relations are believed to affect the delivery of health services3,14 and are useful for creating community capacity.3,16 By adopting a network perspective in the study of coalitions, we hope to expand the potential of social network analysis for measuring social capital.2123
The field of network theory and analysis is well established, but it has had little application to prevention.2426 Of the many different network indices, 2 may have the most potential for representing a coalitions structure: density and centralization. For example, studies of the diffusion of innovations have shown that network density and network centralization are positively associated with faster diffusion of innovations.26 Dense networks provide more pathways where communication about prevention programs can flow compared with sparse networks. Conversely, sparse networks may not provide enough pathways for information to be circulated throughout the coalition. Density also may facilitate diffusion, because dense networks may reflect a cohesive normative environment.3 A network with many links is more likely to have members who share common values or beliefs. Thus, a dense network may reflect a homogenous coalition, and this homogeneity will facilitate information exchange and decisionmaking.20
Additionally, centralized networksthose with ties directed at 1 or a few membersare expected to facilitate the adoption of evidence-based programs. Centralized networks have hubs that can disseminate information to many other members quickly. A centralized coalition has leaders who can enact decisions more readily, because they have positions of power and control.27 Moreover, once central members in a centralized network adopt a program, they are able to locate the right coalition members to implement that program. On the basis of these findings, we expect the adoption of evidence-based practices to be greater among dense coalitions than among sparse ones, and adoption should be greater among centralized networks than among decentralized ones. However, other structural characteristics, such as whether a coalition operates as a single group or as multiple subcommittees, may mitigate these relationships.11
In a highly structured coalition, denser networks (those with a high volume of connections) may not facilitate efficiency or progress.28 First, lower density within a network may reflect more formal collaborations.29 Second, although there is probably a minimum density level within a network needed for coalitions to adopt innovations, once this level is reachedparticularly in structured coalitionstoo much density may be a liability. Too much density within a network can create communities with too few connections to external information and resources, thus making them disadvantaged.26,30,31 Finally, organizational studies have shown that too much density within a network can hurt performance.32,33
Similarly, networks that are too centralized concentrate power, which may result in less shared decisionmaking and lower commitment to prevention programs among noncentral members. Centralized networks are referred to as hierarchical networks, and studies have shown that employees in hierarchical organizations feel less satisfied with their work.3436 Some researchers have advocated for decentralized or horizontal communication networks as being more appropriate for organizations that use electronic communication technology.37 Therefore, although a centralized network is more efficient,38 a decentralized one may be more empowering. Thus, the adoption of new programs may be facilitated in sparser or more decentralized networks.
Steps Toward Effective Prevention (STEP) was a large prevention diffusion trial that included a community coalition intervention component.4,6 We evaluated the effects of this intervention on changing the coalitions network density and centralization. We also evaluated the mediating effects of network change (change in network density or centralization) on subsequent planning and adoption of evidence-based prevention programs. The intervention was designed to increase the efficiency of coalition networks in planning and implementing evidence-based prevention programs by creating an organized coalition where one had previously not existed and by creating more decentralized task work groups where there had been only a single group. At least 2 previous studies have shown that the achievement of benchmarks is significantly associated with the adoption of prevention plans.11,39 We used network analysis methods to measure the coalition structures and explore how the dynamics of the coalition system affected the coalitions ability to implement drug abuse prevention programs. On the basis of previous research, we hypothesized that the intervention would increase the efficiency of existing coalitions by decreasing the networks density and centralization, which in turn would positively affect the progress and adoption of prevention planning.
| METHODS |
|---|
|
|
|---|
Research and Measurement Designs
Cities were matched with 2000 US Census data on demographic variables associated with risk for drug use (percentage of the population that was male, younger than 18 years, White, or had income below the federal poverty level). Matched cities were then assigned within each state to 1 of 3 conditions: televised prevention training plus technical assistance, televised prevention training only, or prevention as usual (control). The data in our study are from baseline (fall 2001) through 18-month follow-up (spring 2003).
Study Participants
Community leaders were identified and recruited through a process of snowball sampling,11 which included 3 criteria: (1) representing 1 or more prevention stakeholders (education, law enforcement, parent groups, youth services, media, local government, business, health or medical profession, special or minority interest group), (2) beingor having the potential to bea positive role model for youth, and (3) willing to participate in a prevention coalition for 2 years. This sampling process resulted in a list of 1041 potential participants (39179 per city). Among these respondents, 1 community leader in each city was identified and trained annually to serve as a site facilitator for STEP, which included organizing other leaders for training and meetings, facilitating data collection, and collecting archival data on meeting process. From the list of potential participants, site facilitators identified 709 individuals from the 24 cities who were considered to be active in terms of having attended at least 1 community or coalition meeting during the previous 12 months.
Respondents completed both a community leader survey and a network survey. Of the 709 active leaders, 670 (94.5%) completed either the community leader or network survey at baseline, and 415 (58.5%) completed both; at 18-month follow-up, data were collected from 406 (57.3%) leaders, and 255 leaders (36% of 709 active leaders at baseline) had completed surveys at both waves of measurement. Thus, there were 821 respondents at baseline and follow-up, and 255 respondents provided data at both waves. Four of the 24 communities at baseline dropped out of the study.
Intervention
The intervention programs consisted of 6 interactive televised training segments on evidence-based prevention programs administered approximately every 6 months; 3 of these training segments occurred during the period of our study. Television broadcasts were complemented with planning meetings, where skills learned in training were shared with other members who did not participate in the live broadcast training. Training moved from large introductory sessions to smaller audience sessions that targeted those who would actively implement prevention programs; 343 leaders participated in the first session, 196 participated in the second session, and 130 participated in the third session. The topics of the first 3 sessions were (1) identifying risk factors and protective factors of drug abuse, (2) organizing the community, and (3) understanding how to interact with local media using established community approaches for communicating public health issues and information.4043
Measures
We used data from 2 surveys. The first surveythe community leader surveyincluded 122 items that measured leader attitudes and behaviors regarding community readiness for prevention program implementation, individual leader skills and attitudes, and coalition functioning. We used measures of coalition functioning, planning, and adopting prevention programs. The outcomes consisted of 4 scales: organizational functioning (sum of 5 items, 5-point scale from strongly disagree to strongly agree;
= 0.83; adapted from Communities United for Prevention21); data-based planning (15 items, 4-point scale from not at all to a lot;
= 0.87; adapted from Communities That Care44,45 and Students Taught Awareness and Resistance46); benchmark achievement (12 items, 4-point scale of progress from none to completed;
= 0.88; adapted from Students Taught Awareness and Resistance39,46); and prevention activity progress (14 items, 5-point scale of progress from none to activity completed;
= 0.90; adapted from Communities That Care44,45 and Students Taught Awareness and Resistance13). Details of scale development and measurement model analysis have been published elsewhere.11 These 4 scores were analyzed separately and were aggregated to an overall prevention planning and adoption score as 1 outcome.
The second survey was the network survey that had both a roster of all coalition members and a question that asked each member to name how frequently they talked with each other. The survey also had 3 open-ended nomination questions that asked members to list up to 7 people to whom they go for advice about prevention issues, with whom they discuss prevention issues, and with whom they were friends. For each community, we calculated 2 network-level measures from the advice network using GAUSS software (Aptech Systems, Seattle, Wash). We first calculated density,

where l is the number of links (nominations made) and n is network size (number of coalition members). Density is determined by counting the number of reported links and dividing by the maximum number of possible links. We also calculated degree centralization,27

where degree is the number of nominations received by each person and n is network size. Degree centralization varies between zero and 1, with higher numbers indicating a more centralized network. Both measures are readily available in network analysis programs.47
Analysis Plan
We conducted a confirmatory factor analysis with the EQS program48 to generate an overall prevention planning composite scoreor second-order factoron the basis of 4 separate planning scores. We then compared the analysis sample with other community leaders who were missing data at either baseline or follow-up; we used the simple unpaired t test for group comparisons on leader characteristics (role, tenure, and number of meetings attended in the last year), density and centralization, and planning and adoption outcomes. Finally, we conducted regression analyses using Stata software.49 The following model was estimated,
![]() | (3) |
where Y2 is 1 of the 5 outcomes in Table 1
at wave 2 and Y1 is the same outcome at wave 1; Tx represents a treatment community; D1 and D2 represent network-level density at waves 1 and 2, respectively; and e is error. The community was the unit of analysis. We aggregated the data 2 ways: for only those who completed both waves 1 and 2 (n=255), and for all respondents who completed either wave 1 or wave 2 surveys (n=821).50 We first tested intervention effects on each network score. We then included network density and centralization at waves 1 and 2 to test the mediated effects of network change on change in program planning and adoption. To increase power, we combined both STEP treatment conditions (training and technical assistance and training only), which showed no differences in network or outcome measures.
|
| RESULTS |
|---|
|
|
|---|
To test for main effects of the intervention, we conducted lagged regression of wave 2 outcomes on a dummy indicator for whether or not the coalition received satellite TV training. There was a significant association that indicated training improved outcomes (data not shown). Table 2
shows standardized regression coefficients for the wave 2 outcomes regressed on their baseline score, baseline density, and wave 2 density. For 3 of the outcomes and the combined score, wave 2 density was significantly and negatively associated with outcomes. Because baseline density was included in the model, the results indicate that density change was negatively associated with outcome change.50 For example, the coefficient for organizational functioning and density at follow-up was ß = 0.44, which indicated that organizational functioning was higher for coalitions that decreased their density (or lower functioning for those with increased density).
|
Figure 1
illustrates the change in the composite outcome by change in density. It also shows that density increased in the control communities; however, these communities had lower increases in program adoption. This indicates that perhaps the absence of an intervention in the control condition led to increased communication among members but no change in their ability to adopt programs, whereas an intervention did not change network density but did create an increase in the adoption of evidence-based practices.
|
|
![]() | (4) |
![]() | (5) |
where Tx indicates a treatment community; D1 and D2 are network-level densities at wave 1 and wave 2, respectively; and Y1 and Y2 are the outcome variables measured at waves 1 and 2, respectively. These path models are considered to be saturated models with perfect fit to the data. Figure 2
shows that the intervention was negatively associated with density at wave 2, which indicates that being in the control condition increased density. Results also indicate that wave 1 density was positively associated with wave 2 density, and wave 1 outcomes were positively associated with wave 2 outcomes, as expected. Wave 2 density was negatively associated with wave 2 outcomes, which indicates that decreasing density was associated with lower program adoption.
| DISCUSSION |
|---|
|
|
|---|
More communication, in the absence of promotions (satellite TV in this case) that provide information about evidence-based programs, does not lead to increased adoption of evidence-based practices. Thus, the public health system needs to continue informing coalitions and community planners about evidence-based practices.
Our results are consistent with Granovetters strength of weak ties theory.31 Communities that are less dense may have weak ties to other organizations that provide access to resources and power, which can be mobilized to adopt evidence-based practices. Too much density indicates that connections are directed within the group and do not provide sufficient pathways for information and behaviors to come from outside the group. Too much density leaves a coalition ineffective at mobilizing the resources it needs to adopt evidence-based prevention programs. To be sure, some density is necessary for the coalition to operate, but too much density can be counterproductive. Coalitions need to balance their efforts between creating a dense, cohesive group versus retaining some connections to outside resources.
The association between coalition density and adoption of prevention programs may be time dependent. New coalitions might need to move "from modest levels of collaboration to increasingly dense and multiplex relationships that can be used to address complex health problems." 3(p658) Over time, however, this increasing density may become a liability, because it overly insulates the coalition from new ideas or access to new resources. On the other hand, communities that have had no coalition and that build one for the first time may require network density and centralization to get prevention planning moving. Coalition leaders must therefore be cognizant of the dynamic nature of coalition networks and networks ability to address community concerns, but they must not sacrifice adaptation for cohesion.
Cohesion, shared mission and goals, and common values are the hallmark of community coalitions.51 These factors may not translate into the successful adoption of prevention programs without leadership, however. That leadership can be authoritarian or egalitarian, which might be reflected in either centralized or decentralized network structures. Either one might be more successful at adopting programs but for different reasons.52 We did not find support in this study for an association between centralization and adoption, and we hope future research will shed more light on this relationship.
The systems perspective prompted us to measure the structure of interpersonal interactionwho goes to whom for advicerather than rely only on frequency of interactions as a measure of communication. The communication scale included in the survey did not change significantly between baseline and follow-up and was not associated with adoption, density, or changes in density. Thus, the system perspective we used uncovered significant network dynamics that were not apparent in individual reports.
The main finding from our study is that we should not assume increased communication in the form of network density will always benefit coalition functioning. In this case, it was associated with decreased ability to adopt evidence-based programs. System-level thinking and measures helped us reexamine naïve expectations about how community coalitions function and how to improve their capacity for the adoption of programs that work.
| Acknowledgments |
|---|
Human Participant Protection
All procedures were reviewed and approved by the University of Southern California institutional review board.
| Footnotes |
|---|
Contributors
T. W. Valente originated the study and conducted the network analysis. C. P. Chou conducted the path analysis. M. A. Pentz designed and implemented the STEP trial. All authors wrote the article.
Accepted for publication November 2, 2005.
| References |
|---|
|
|
|---|
2. Berkowitz B, Wolff T. The Spirit of the Coalition. Washington, DC: American Public Health Association; 2000.
3. Provan KG, Nakama L, Veazie MA, Teufel-Shone NI, Huddleston C. Building community capacity around chronic disease services through a collaborative interorganizational network. Health Educ Behav. 2003; 30:646662.[Abstract]
4. Pentz MA. Form follows function: designs for prevention effectiveness and diffusion research. Prev Sci. 2004;5:2329.[CrossRef][Web of Science][Medline]
5. Saxe L, Reber E, Hallfors D, et al. Think globally, act locally: assessing the impact of community-based substance abuse prevention. Eval Program Plann. 1997; 20:357366.[CrossRef][Web of Science]
6. Pentz MA. Evidence-Based Prevention: Characteristics, impact, and future direction. J Psychoactive Drugs. 2003;35(special suppl):143152.[Medline]
7. Center for Substance Abuse Prevention (CSAP). CSAPs prevention portal: model programs, 2002. Available at: http://modelprograms.samhsa.gov/template.cfm. Accessed May 16, 2005.
8. Hawkins DJ, Catalano RF, Arthur MW. Promoting science-based prevention in communities. Addictive Behav. 2002;27:951976.[CrossRef][Web of Science][Medline]
9. Butterfoss FD, Goodman RM, Wandersman A. Community coalitions for prevention and health promotion: factors predicting satisfaction, participation and planning. Health Educ Q. 1996;23:6579.[Web of Science][Medline]
10. Hays CE, Hays S.Pl, DeVille JO, Mulhall PF. Capacity for effectiveness: the relationship between coalition structure and community impact. Eval Program Plann. 2000;23:373379.[CrossRef][Web of Science]
11. Jasuja GK, Chou CP, Bernstein K, Wang E, McClure M, Pentz MA. Using structural characteristics of community coalitions to predict progress in adopting evidence-based prevention programs. Eval Program Plann. 2005;28:173184.[CrossRef][Web of Science]
12. Kegler M, Steckler A, McLeroy K, Malek SH. Factors that contribute to effective community health promotion coalitions: a study of 10 Project ASSIST coalitions in North Carolina. Health Educ Res. 1998;13: 225238.
13. Mansergh G, Rohrbach L, Montgomery SB, Pentz MA, Johnson CA. Process evaluation of community coalitions for alcohol and other drug prevention: comparison of two models. J Community Psychol. 1996; 24:118135.[CrossRef][Web of Science]
14. Kwait J, Valente TW, Celentano DD. Interorganizational relationships among HIV/AIDS service organizations in Baltimore: a network analysis. J Urban Health. 2001;78:468487.[Web of Science][Medline]
15. Stuart TE. Network positions and propensities to collaborate: an investigation of strategic alliance formation in a high-technology industry. Admin Sci Q. 1998; 43:668698.[CrossRef]
16. Wickizer T, Von Korff M, Cheadle A, et al. Activating communities for health promotion: a process evaluation method. Am J Public Health. 1993;83: 122129.
17. Ennett ST, Bauman KE. Peer group structure and adolescent cigarette smoking: a social network analysis. J Health Soc Behav. 1993;34:226236.[CrossRef][Web of Science][Medline]
18. Alexander C, Piazza M, Mekos D, Valente TW. Peer networks and adolescent cigarette smoking: an analysis of the national longitudinal study of adolescent health. J Adolesc Health. 2001;29:2230.[CrossRef][Web of Science][Medline]
19. Valente TW, Watkins S, Jato MN, Van der Straten A, Tsitsol LM. Social network associations with contraceptive use among Cameroonian women in voluntary associations. Soc Sci Med. 1997;45:677687.[CrossRef][Web of Science][Medline]
20. Rogers EM. Diffusion of Innovations. 5th ed. New York, NY: Free Press; 2003.
21. Moore S, Shiell A, Hawe P, Haines V. The privileging of communitarian ideas: citation practices and the translation of social capital into public health research. Am J Public Health. 2005;95:13301337.
22. Pearce N, Smith GD. Is social capital the key to inequalities in health? Am J Public Health. 2003;93: 122129.
23. Lomas J. Social capital and health: implications for public health and epidemiology. Soc Sci Med. 1998;47: 11811188.[CrossRef][Web of Science][Medline]
24. Scott J. Network Analysis: A Handbook. Newbury Park, Calif: Sage; 2000.
25. Wasserman S, Faust K. Social Networks Analysis: Methods and Applications. Cambridge, UK: Cambridge University Press; 1994.
26. Valente TW. Network Models of the Diffusion of Innovations. Cresskill, NJ: Hampton Press; 1995.
27. Freeman L. Centrality in social networks: conceptual clarification. Soc Networks. 1979;1:215239.[CrossRef][Web of Science]
28. Guimera R, Arenas A, Díaz-Guilera A, Giralt F. Dynamical properties of model communication networks. Physical Review E Stat Nonlin Soft Matter Phys. 2002;66(2 pt 2):026704.
29. Singer HH, Kegler MC. Assessing interorganizational networks as a dimension of community capacity: illustrations from a community intervention to prevent lead poisoning. Health Educ Behav. 2004;31:808821.[Abstract]
30. Gans H. The Urban Villagers: Group and Class in the Life of Italian-Americans. New York, NY: Free Press; 1962.
31. Granovetter M. The strength of weak ties. Am J Sociol. 1973;78:13601380.[CrossRef]
32. Oh H, Chung MH, Labianca G. Group social capital and group effectiveness: the role of informal socializing ties. Acad Manage J. 2004;47:860875.[Web of Science]
33. Uzzi B. Social structure and competition in inter-firm networks: the paradox of embeddedness. Admin Sci Q. 1997;42:3567.[CrossRef]
34. Shaw ME. Communication networks. In: Berkowitz L, ed. Advances in Experimental Social Psychology. New York, NY: Academic Press; 1964: 111147.
35. Roberts KH, OReilly III CA. Some correlates of communication roles in organizations. Acad Manage J. 1979;22:4257.[CrossRef][Web of Science]
36. Flap H, Völker B. Goal specific social capital and job satisfaction: effects of different types of networks on instrumental and social aspects of work. Soc Networks. 2001;23:297320.[CrossRef][Web of Science]
37. Barabasi AL. Linked: How Everything Is Connected to Everything Else and What It Means for Business, Science and Everyday Life. New York, NY: Plume; 2003.
38. Malone T. The Future of Work: How the New Order of Business Will Shape Your Organization, Your Management Style and Your Life. Boston, Mass: Harvard Business School Press; 2004.
39. Pentz MA. Community organization and school liaisons: how to get programs started. J School Health. 1986;56:382388.[Web of Science][Medline]
40. Bandura A, Jeffrey RW, Wright CL. Efficacy of participant modeling as a function of response induction aids. J Abnorm Psychol. 1974;83:5664.[CrossRef][Web of Science][Medline]
41. Hawkins JD, Catalano RF. Communities that Care: Action for Drug Abuse Prevention. San Francisco; Calif: Jossey-Bass; 1992.
42. Pentz MA, Dwyer JH, MacKinnon DP, et al. A multi-community trial for primary prevention of adolescent drug abuse: effects on drug use prevalence. JAMA. 1989;261:32593266.
43. Pentz MA, Mihalic SF, Grotpeter JK. The Midwestern prevention project. In: Elliot DS, ed. Blueprints for Violence Prevention. Boulder, Colo: University of Colorado; 1997:343.
44. Arthur MW, Hawkins DJ, Catalano RF, Olson JJ. Diffusion Project: Fall 1998 Community Key Informant Interview. Seattle, Wash: University of Washington; 1998.
45. Greenberg M, Osgood W. Technical report on the Community Evaluation Scales (CES). University Park, Pa: Pennsylvania State University; 2000.
46. Pentz MA, Valente TW. (1993). Project STAR: a substance abuse prevention campaign in Kansas City. In: Becker TE, Rogers EM, eds. Organizational Aspects of Health Communication Campaigns: What Works? Newbury Park, Calif: Sage Publications; 1993:3760.
47. Borgatti SP, Everett MG, Freeman LC. UCINET for Windows: Software for Social Network Analysis. Harvard, Mass: Analytic Technologies; 2004.
48. Bentler PM. EQS Structural Equations Program Manual. Encino, Calif: Multivariate Software, Inc; 1995.
49. Intercooled STATA 8.0 for Windows. College Station, Tex: STATA; 2003.
50. Valente TW. Evaluating Health Promotion Programs. New York, NY: Oxford University Press; 2002.
51. Goodman RM, Speers MA, McLeroy K, et al. Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Educ Behav. 1998;25:258278.[Abstract]
52. Kadushin C. Why it is so difficult to form effective coalitions. City Community. 2005;4:255275.[CrossRef]
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |