Journal of Public Health Management & Practice:
Advancing Environmental and Policy Change Through Active Living Collaboratives: Compositional and Stakeholder Engagement Correlates of Group Effectiveness
Litt, Jill PhD; Reed, Hannah BS; Zieff, Susan G. PhD; Tabak, Rachel G. PhD; Eyler, Amy A. PhD; Tompkins, Nancy O'Hara PhD; Lyn, Rodney PhD; Gustat, Jeanette PhD, MPH; Goins, Karen Valentine MPH; Bornstein, Daniel BS
Department of Environmental Health, Colorado School of Public Health, Aurora, Colorado (Dr Litt and Ms Reed); Department of Kinesiology, San Francisco State University, San Francisco, California (Dr Zieff); Prevention Research Center, Washington University in St Louis, St. Louis, Missouri (Drs Tabak and Eyler); Prevention Research Center, West Virginia University, Morgantown, West Virginia (Dr Tompkins); Policy Leadership for Active Youth, Institute of Public Health, Georgia State University, Atlanta, Georgia (Dr Lyn); Department of Epidemiology, Prevention Research Center, Tulane University School of Public Health and Tropical Medicine, New Orleans, Louisiana (Dr Gustat); Preventive and Behavioral Medicine, University of Massachusetts Medical School, Worcester, Massachusetts (Ms Goins); and Department of Exercise Science, Arnold School of Public Health, University of South Carolina, Columbia, South Carolina (Mr Bornstein).
Correspondence: Jill Litt, PhD, Department of Environmental Health, Colorado School of Public Health, 13001 East 17th Place, Aurora, CO 80045 (firstname.lastname@example.org).
This study was supported by the Centers for Disease Control and Prevention's (CDC's) Special Interest Project 09-10: Physical Activity Policy Research Network (U48DP001938). The content is solely the responsibility of the authors and does not necessarily represent the official views of the CDC.
We are thankful for the support and guidance from our partners at LiveWell Colorado, Kaiser Permanente, and the Wisconsin Department of Health Services. We gratefully acknowledge Denver Environmental Health staff and research staff members of the participating Physical Activity Policy Research Network coordinating and collaborating centers and Ms Sharon Scarbro of the Rocky Mountain Prevention Research Center for their assistance with this project. We thank the physical activity practitioners and staff who submitted nominations and the coordinators who agreed to participate. Our work would not be possible without them.
The authors declare no conflicts of interest.
Objective: This study aims to evaluate compositional factors, including collaborative age and size, and community, policy, and political engagement activities that may influence collaboratives' effectiveness in advancing environmental improvements and policies for active living.
Design/Participants/Setting: Structured interviews were conducted with collaboratives' coordinators. Survey items included organizational composition, community, policy, and political engagement activities and reported environmental improvements and policy change. Descriptive statistics and multivariate models were used to investigate these relationships.
Main Outcome Measure(s): Environmental improvement and policy change scores reflecting level of collaborative effectiveness across 8 strategy areas (eg, parks and recreation, transit, streetscaping, and land redevelopment).
Results: Fifty-nine collaborative groups participated in the interview, representing 22 states. Groups have made progress in identifying areas for environmental improvements and in many instances have received funding to support these changes. Results from multivariate models indicate that engagement in media communication and advocacy was statistically correlated with higher levels of environmental improvement, after adjusting for age of group and area poverty levels (P < .01). Groups that frequently solicited endorsements from community leaders and offered testimony in policy or legal hearings reported significantly more policy change, after adjusting for age of group and area poverty levels (P < .01 for both).
Conclusions: Active living collaboratives are translating the evidence on environmental and policy approaches to promote active living from research to practice. Investing in community and policy engagement activities may represent important levers for achieving structural and policy changes to the built environment.
The increasing presence of community collaboratives (including coalitions, networks, and partnerships) during the past decade can be attributed in part to rising expectations for communities to address complex health issues that are unresponsive to top-down or single-solution programs.1 Obesity and risk factors such as physical inactivity, which are rooted at many levels—households, institutions, communities, and beyond—require multilevel and multisectoral solutions.2 Programs and initiatives designed to increase individual-level physical activity, for example, have had minimal impact in the absence of multilevel, multisectoral strategies designed to change the built environment and related policies that support and sustain these changes.3 Collaborative groups are often better positioned than individuals, organizations, or sectors to translate national health guidelines and recommendations into action at the state and local levels.1,4 These groups can influence broader systems-level change required to realize and maintain health improvements due to their diverse partnerships and strategic interests in identifying and implementing programs, policies, and structural improvements for a targeted issue.4–7
Research on collaborative group effectiveness spans multiple disciplines and has often focused on short-term outcomes.8,9 Factors such as leadership, management, communication, and stakeholder participation have been associated with collaborative-specific outcomes, such as member participation,10 member satisfaction,11,12 and perceived effectiveness.13,14 More recently, research efforts have considered collaborative effectiveness in achieving intermediate outcomes such as environmental and policy change and the factors that influence these changes.4,15–17 For example, engagement and empowerment represent mechanisms for stakeholder participation, influence, and decision making, thus allowing a broader constituency to become change agents in their communities.1,4,6,8,18–21 Basic processes, activities, and actions reflecting different types of community engagement and empowerment include problem definition (eg, needs assessments), agenda setting (eg, goals and objectives), community awareness (eg, media advocacy, social marketing), and policy development (eg, offering testimony, drafting legislation, engaging legislators).21
In response to the aforementioned challenges, national, regional, and local funding organizations together with research and government organizations are encouraging and sometimes requiring communities across the country to form collaboratives to improve the built environment and related policies.3 In response, these groups are devising multifaceted solutions, including efforts to improve amenities and services related to parks, recreational facilities and other public spaces, transit systems, and urban infrastructure as well as plans to reshape policies to facilitate, support, and/or sustain these changes. Although such efforts are well underway, only limited information is available about the effectiveness of active living collaboratives.22 This study aims to evaluate compositional factors and community, policy, and political engagement activities that may influence collaboratives' effectiveness in advancing environmental improvements and policies for active living.
We conducted this research as part of the Centers for Disease Control and Prevention–funded Physical Activity Policy Research Network (http://paprn.wustl.edu). The conceptual basis of this research is informed by the “community capitals” literature, which underscores the importance of involving people so that they can directly influence change from within a community.23,24 It also builds upon past research on partnership synergy and community engagement which emphasizes the importance of strong social structures and authentic stakeholder participation to enhance capacity of collaboratives to solve problems and sustain change.1,21
Collaborative groups (herein referred to as “groups”) were identified through an online search and referrals from Physical Activity Policy Research Network members, the Physical Activity and Public Health Practitioners Course alumni, and the National Society for Physical Activity Practitioners in Public Health. Groups were initially contacted via e-mail and interviews were scheduled over the phone. Phone interviews were conducted with group coordinators between May and August 2011. These structured interviews collected information about group composition, stakeholder engagement activities, and efforts to achieve environmental and policy change. Details about the interview protocol are described elsewhere.22
Environmental improvement was defined as physical changes to the built environment in 8 strategy areas: (a) parks, open spaces, and recreation facilities; (b) transit and parking; (c) children's play areas; (d) public plazas; (e) streetscaping; (f) street improvements; (g) infill and redevelopment; and (h) Safe Routes to School. The strategy areas were adapted from the NY Active Design Guidelines25 and themes developed by LiveWell Colorado and Kaiser Permanente.26 Coordinators were asked to indicate the strategy areas on which they worked and rate the level of change accomplished on a 5-point scale (1 = Identified, 2 = Discussed; 3 = Funded; 4 = In progress, and 5 = Completed). For every group, ratings for each strategy area were averaged and then normalized by the number of strategy areas identified by the collaborative coordinator to obtain a single score for environmental improvements. Higher scores represent greater success in achieving change.
Policy change measured the extent to which a group developed new or modified existing policy to support built environment improvements. For each of the 8 strategy areas identified, respondents were asked whether the improvement required changes to existing policy or the development of new policy. The status of working on a new or improved policy was rated on a 5-point scale (1 = No new policy, 2 = Policy gap identified, 3 = New policy discussed, 4 = Policy drafted, and 5 = Policy adopted). Ratings for each strategy area were averaged and then normalized by the number of strategy areas to obtain a single policy change score for each group, with higher scores representing greater progress in the policy-making process.
Tenure of coordinator reflected the number of years the coordinator had been in his/her current position and was categorized into 3 groups: 1 year or less, more than 1 to 3 years, and more than 3 years. Collaborative age was calculated on the basis of the year in which a group was established. Age of collaborative is included as a covariate in all analyses given that groups with more experience may be more likely to achieve system-level change.13,27 Collaborative size specified the number of partner organizations that actively participate in the collaborative and was categorized by size (≤10, 11-30, and >30). Strategic partnership with planning experts was assessed by asking the coordinator how frequently the group partnered with planning and design practitioners (1 = Never to 5 = Very frequently).
Stakeholder engagement activities
Community activities included measures of needs assessment activities, community events, and the use of social marketing.16 Physical activity opportunity assessment measured whether groups conducted walkability and bikeability audits or secondary data analysis (completed/not completed). Community events included events, such as hosting bike, safety, and awareness events and categorized them into 3 levels (Low = 1 event type; Medium = 2 event types; and High = All 3 event types). Social networking strategies measured whether groups used social media (eg, Facebook, Twitter) and social marketing (eg, billboards, radio, or television announcements) techniques to increase awareness and connect with partners and constituents.
Political and policy activities were assessed using 4 items: engaging with elected or appointed officials to author policy, receiving endorsement or support from community leaders, offering testimony in policy or legal hearings, and engaging in media communication.21 Respondents rated how frequently their group engaged in each activity for each of these variables (1 = Never to 5 = Very frequently).
Geographic scale represents 2 levels in which the group worked: local level (including neighborhood, city, and county) and state level. Area poverty was defined as the percentage of families living below the poverty level28 in the area served by the collaborative, as reported by the group coordinator. Area poverty has been shown to negatively impact the quality of coalition functioning and thus was included as a covariate in all models.27
We calculated mean environmental improvement and policy change scores by study covariates using the LSMEANS command within SAS MEANS procedure. A partial F test was used to determine whether there were differences in mean scores across variables.29 We used general linear regression models to evaluate the bivariate and multivariate relationships between the covariates and the 2 dependent measures, environmental improvement, and policy change. We developed 3 domain-specific models for each outcome: compositional attributes (Model 1a and 1b), community engagement activities (Model 2a and 2b), and policy activities (Model 3a and 3b). Domain-specific models included those variables from the bivariate analyses with a P value of less than .10. The final models (Model 4a and 4b) included variables from the domain-specific models that were statistically significant (P < .05).
Fifty-nine groups, representing 22 states, of 96 total groups invited participated in the survey (61%). Groups focused on various themes related to physical activity and active living including active transportation at the state level to community gardens and greening in urban settings to community-specific groups working to increase opportunities for healthy eating and active living.
Groups' environmental improvement scores ranged from 1.5 to 5.0, with an average of 3.5 (SD: 0.9). This average indicated that groups typically had funding to support their initiatives and had started but had not completed the planned improvements. Groups' policy change scores ranged from 1.0 to 4.5 with an average of 2.9 (SD: 1.0), suggesting that groups had generally identified a policy gap and had started discussions to develop new policies or changes to existing policy.
Groups using social marketing scored higher in environmental improvements and policy change (Table 1). Moreover, local groups, when compared with state-level groups, reported more success in advancing environmental and policy changes, although this trend was not statistically significant. Groups that organized more community events, using social media, and very frequently engaged in media communication and media advocacy reported more success in achieving environmental improvements. Regarding policy change, groups that had been together for longer periods of time or engaged in any of the 4 policy engagement activities had higher policy change scores (Table 1).
Results from our bivariate and multivariate models are presented in Table 2. Bivariate associations between compositional factors, such as age of collaborative, collaborative size, experience of coordinator, engagement of planning and design professionals, and environmental improvement scores were positive but not statistically significant. Bivariate associations between community engagement activities, including hosting more community events, using social marketing and social media, and higher environmental improvement scores, were positive and statistically significant (P < .05). In the community context model (Model 2a), hosting community events yielded the only positive and statistically significant association with environmental improvement scores (β = .3, P < .05). In the political and policy engagement model (Model 3a), engagement in media communication and advocacy was positively and significantly associated with environmental improvement scores (β = .4, P < .01). In the final environmental improvement model (Model 4a), the statistically significant association between frequent engagement in media communication and advocacy and higher levels of environmental improvement scores remained, after adjusting for age of group and area poverty levels (β = .3, P < .01).
Bivariate correlations between stakeholder engagement activities and policy change were positive and significant (Table 2). In our multivariate models, groups that frequently solicited endorsements from community leaders (β = .3, P < .05) and frequently offered testimony in policy or legal hearings (β = .4, P < .01) reported significantly more policy change (Model 3b). These relationships from Model 3b remained significant after adjusting for age of group and area poverty levels in the final policy change model (Model 4b).
This analysis examines the capacity of active living collaborative groups to make changes to the built environment and to develop related policy. While all groups report progress in environment and policy change, their success varies within and across strategy areas. Allen and colleagues13,30 report similar findings among councils working on domestic violence-related organizational policies, protocols, and practices. From their research, the authors emphasize the need to examine a dynamic set of internal and external factors that influence institutionalized change.
Active living collaborative groups examined in this study vary in the diversity and frequency of activities deployed to engage and empower community members. Such engagement and empowerment of the broader community may be critical to groups' abilities to pursue strategies to improve the built environment.1,31 Groups that use a range of approaches to assess the needs of a particular community, such as participatory walkability and bikeability assessments, can engage residents while at the same time generate local knowledge about the built environment and unmet civic needs (eg, shade structures along walking trails and furniture such as park benches). Moving along the community engagement continuum, groups sponsoring community events, such as bike-to-work or walk-to-school days, report more success in achieving environmental improvements. These activities build on a fundamental recognition that social ties that expand a group's sphere of influence are key to achieving desired system-level changes.5,19,32 Finally, investing in social media and social marketing is key to raising awareness, thus furthering social capital and mobilization of resources.33 The visibility of these activities empowers individuals and organizations, elicits local knowledge, and strengthens relationships with partners and the broader community, thus influencing public support for environmental improvements.5,19,20,34,35
Frequent engagement in media communication and advocacy was associated with higher environmental improvement scores. Writing letters to the editor of a local or regional newspaper, releasing a press statement, or mounting a mass media campaign furthers community awareness and public support for proposed environmental changes.31 Such advocacy may also influence change-making processes by feeding into the momentum of the initiative, influencing the perceptions of key leaders, and applying pressure for policy change.36,37
Groups vested in political and policy advocacy activities were also more likely to achieve policy change. Specifically, groups were most likely to be successful when they frequently offered testimony in public hearings and solicit community leader endorsements for collaborative-sponsored events. Engaging community leaders may be vital for extending the groups' influence in facilitating such changes.5,6 Kingdon38 has shown that such investment in frontline policy activities is crucial for advancing a policy agenda.
Convincing government entities and nonprofit organizations in collaborative group leadership roles to engage in policy advocacy may be challenging due to a perception that such advocacy activities will compromise funding. Blackwell et al, citing Homan (chapter 7), have found that this fear may be exaggerated and not in line with actual federal or foundation grantee guidelines.39,40 If government or other funder restrictions prevail, then lead organizations may need to give allied partners without such conflicts more responsibility for testifying and advocating on behalf of the group.
Finally, groups in the implementation stage of collaborative development may have greater latitude in the way their groups are organized and managed. Consistent with previous research, compositional features of groups, such as collaborative size, were not significant in explaining groups' effectiveness.16 Rather, groups can invest in activities that engage stakeholders across the spectrum of political, policy and community settings in order to generate the social and human capital necessary to influence environmental improvements and policy change.
There are several limitations worth noting. First, the cross-sectional design limits the exploration of temporal aspects of group processes and related outcomes. Second, because the sample was constructed using a nomination process, results may reflect the work of groups with greater visibility and more successful initiatives and thus may not be generalizable to all active living collaborative groups. Third, collection of data from group coordinators may bias results in a positive direction given their investment in their respective groups. Fourth, the statistical power is limited given the small sample size.
This research examines the changes active living collaborative groups are undertaking to improve physical activity levels in communities across America. Our research suggests that groups are translating the evidence on environmental and policy approaches to promote active living from research to practice. Community and policy engagement activities are widely used by groups but intensity of use varies across groups. Groups are most effective in making improvements to the built environment and changes to the policy landscape when they dedicate substantial resources to engage their members, the broader community, and decision makers in the work of the collaborative.18 Technical assistance offered by funders and supporting organizations may strengthen collaborative groups' approach to engaging in the policy-making process by improving communication of information in policy-making settings.41
1. Lasker RD, Weiss ES, Miller R. Partnership synergy: a practical framework for studying and strengthening the collaborative advantage. Milbank Q. 2001;79(2):179–205.
2. Fawcett S, Schultz J, Watson-Thompson J, Fox M, Bermby R. Building multisectoral partnerships for population health and equity. Prev Chronic Dis. 2010;7(6):1–7.
3. US National Physical Activity Plan Committee. National Physical Activity Plan. Columbia, SC: US National Physical Activity Plan Committee; 2010.
4. Nowell B. Profiling capacity for coordination and systems change: the relative contribution of stakeholder relationships in interorganizational collaboratives. Am J Community Psychol. 2009;44(3):196–212.
5. Allen NE, Javdani S, Lehrner AL, Walden AL. “Changing the text”: modeling council capacity to produce institutionalized change. Am J Community Psychol. 2012;49(3):317–331.
6. Foster-Fishman P, Berkowitz S, Lounsbury D, Jacobson S, Allen N. Building collaborative capacity in community coalitions: a review and integrative framework. Am J Community Psychol. 2001;29(2):241–261.
7. Roussos ST, Fawcett SB. A review of collaborative partnerships as a strategy for improving community health. Annu Rev Public Health. 2000;21:369–402.
8. Kegler M, Williams C, Cassell C, et al. Mobilizing communities for teen pregnancy prevention: associations between coalition characteristics and perceived accomplishments. J Adolescent Health. 2005;37(3):S31–S41.
9. Zakocs RC, Edwards EM. What explains community coalition effectiveness?: a review of the literature. Am J Prev Med. 2006;30(4):351–361.
10. Kegler M, Steckler A, Mcleroy K, Malek S. Factors that contribute to effective community health promotion coalitions: a study of 10 project assist coalitions in North Carolina. Health Educ Behav. 1998;25(3):338–353.
11. Butterfoss F, Goodman R, Wandersman A. Coalitions for prevention and health promotion. Health Educ Res. 1993;8(3):315–330.
12. Weiner BJ, Alexander JA, Shortell SM. Management and governance processes in community health coalitions: a procedural justice perspective. Health Educ Behav. 2002;29(6):737–754.
13. Allen N. A multi-level analysis of community coordinating councils. Am J Community Psychol. 2005;35(1):49–63.
14. Feinberg ME, Greenberg MT, Osgood DW. Readiness, functioning, and perceived effectiveness in community prevention coalitions: a study of communities that care. Am J Community Psychol. 2004;33(3):163–176.
15. Javdani S, Allen N. Proximal outcomes matter: a multilevel examination of the processes by which coordinating councils produce change. Am J Community Psychol. 2011;47(1):12–27.
16. Jasuja GK, Chou CP, Bernstein K, Wang E, McClure M, Pentz MA. Using structural characteristics of community coalitions to predict progress in adopting evidence-based prevention programs. Eval Program Plann. 2005;28(2):173–184.
17. Snell-Johns J, Imm P, Wandersman A, Claypoole J. Roles assumed by a community coalition when creating environmental and policy-level changes. J Community Psychol. 2003;31(6):661–670.
18. Javdani S, Allen N. Councils as empowering contexts: mobilizing the front line to foster systems change in the response to intimate partner violence. Am J Community Psychol. 2011;48(3):208–221.
19. Lasker RD, Weiss ES. Broadening participation in community problem solving: a multidisciplinary model to support collaborative practice and research. J Urban Health. 2003;80(1):14–60.
20. Minkler M. Community Organizing and Community Building for Health and Welfare. 3rd ed. New Brunswick, NJ: Rutgers University Press; 2012.
21. Minkler M, Garcia A, Williams J, LoPresti T, Lilly J. Si se puede: Using participatory research to promote environmental justice in a latino community in San Diego, California. J Urban Health. 2010;87(5):796–812.
22. Litt JS, Reed HL, Tabak RG, et al. Active living collaboratives in the United States: understanding characteristics, activities, and achievement of environmental and policy change. Prev Chronic Dis. 2013;10:120162. doi: http://dx.doi.org/10.5888/pcd10.120162
23. Emery M, Flora C. Spiraling-up: Mapping community transformation with community capitals framework. Community Dev. 2006;37(1):19–35.
24. Flint R. Seeking resiliency in the development of sustainable communities. Hum Ecol. 2010;17(1):44–57.
25. City of New York. Active Design Guidelines: Promoting physical Activity and Health in Design. New York, NY: City of New York; 2010.
27. Brown L, Feinberg M, Greenberg M. Determinants of community coalition ability to support evidence-based programs. Prev Sci. 2010;11(3):287–297.
28. American Community Survey [computer program]. Version FILES: 2006-2010 American Community Survey 5-year Estimates. Washington, DC: US Census Bureau; 2008.
29. SAS [computer program]. Version 9.2. Cary, NC: SAS Institute; 2011.
30. Allen N, Watt K, Hess J. A qualitative study of the activities and outcomes of domestic violence coordinating councils. Am J Community Psychol. 2008;41(1):63–73.
31. Mayer J, Soweid R, Dabney S, Brownson C, Goodman R, Brownson R. Practices of successful community coalitions: a multiple case study. Am J Health Behav. 1998;22(5):368–377.
32. Korfmacher K. Boundary networks and Rochester's “smart” lead law: the use of multidisciplinary information in a collaborative policy process. New Solut. 2010;20(3):317–336.
33. Blacksher E, Lovasi G. Place-focused physical activity research, human agency, and social justice in public health: taking agency seriously in studies of the built environment. Health Place. 2012;18(2):172–179.
34. Mizrahi T, Rosenthal B. Complexities of coalition building: leaders' successes, strategies, struggles and solutions. Soc Work. 2001;46(1):63–78.
35. Wolff T. Community coalition building—contemporary practice and research: introduction. Am J Community Psychol. 2001;29(2):165–172.
36. Dorfman L, Gonzalez P. Media advocacy: a strategy for helping communities change policy. In:Minkler M, ed. Community Organizing and Community Building for Health and Welfare. 3rd ed. New Brunswick, NJ: Rutgers University Press; 2012:407–420.
37. Stevenson J, Mitchell R. Community-level collaboration for substance abuse prevention. J Prim Preven. 2003;23(3):371–404.
38. Kingdon J. Agendas, Alternatives, and Public Policies. 2nd ed: New York, NY; Addison-Wesley Educational Publishers Inc; 1995.
39. Blackwell A, Thompson M, Freudenberg N, Ayers J, Schrantz D, Minkler M. Using community organizing and community building to influence public policy. In:Minkler M, ed. Community Organizing and Community Building for Health and Welfare. 3rd ed. New Brunswick, NJ: Rutgers University Press; 2012:371–385.
40. Homan M. Promoting Community Change: Making It Happen in the Real World. 5th ed. Pacific Grove, CA: Brooks/Cole; 2011.
41. Stamatakis KA, McBride TD, Brownson RC. Communicating prevention messages to policy makers: the role of stories in promoting physical activity. J Phys Act Health. 2010;7(suppl 1):S99–S107.
active living; community collaboratives; environmental change; policy; stakeholder engagement
© 2013 Lippincott Williams & Wilkins, Inc.
Highlight selected keywords in the article text.