Secondary Logo

Perceptions of Public Health 3.0

Concordance Between Public Health Agency Leaders and Employees

Balio, Casey P., BA; Yeager, Valerie A., DrPH, MPhil; Beitsch, Leslie M., MD, JD

Journal of Public Health Management and Practice: March/April 2019 - Volume 25 - Issue - p S103–S112
doi: 10.1097/PHH.0000000000000903
Research Reports: Research Full Report

Context and Background: The newest era of public health, deemed “Public Health 3.0,” supports cross-sector collaborations to address social determinants of health. These activities often require collaborations with nontraditional public health entities. As this new era begins, it is important to understand perceptions of the public health workforce with regard to Public Health 3.0.

Objective: To assess perceptions of support toward Public Health 3.0 activities by the public health workforce, identify characteristics associated with support, and measure concordance in support between agency directors and the general workforce.

Design: This cross-sectional study utilizes the 2017 Public Health Workforce Interests and Needs Survey to understand support and concordance regarding Public Health 3.0 activities by a nationally representative sample of governmental public health employees. Logistic regression models are used to identify characteristics associated with support of each 3.0 activity and concordance.

Main Outcome Measures: Governmental public health employees' opinions on how involved their agency should be in the K-12 education system, the economy, the built environment, transportation, housing, social connectedness, and health equity within their jurisdiction and concordance in support of involvement between agency directors and the general workforce.

Results: Overall, individual perceptions supporting involvement were highest for health equity and social connectedness and lowest for transportation. Supervisory status, education, and being at a local health department were associated with greater odds of supporting all 3.0 activities. Concordance with agency directors was greatest among other executives relative to nonsupervisors.

Conclusions: There is overall generally high support of many 3.0 activities, but there are gaps in agreement by supervisory status, gender, race/ethnicity, education, role type, and jurisdiction. Findings may help support agency leaders in better communicating the role of their agencies in Public Health 3.0 activities, and workforce education regarding such activities may be necessary for the success of Public Health 3.0's success.

Indiana University Richard M. Fairbanks School of Public Health, Indianapolis, Indiana (Ms Balio and Dr Yeager); and Florida State University College of Medicine, Tallahassee, Florida (Dr Beitsch).

Correspondence: Casey P. Balio, BA, Indiana University Richard M. Fairbanks School of Public Health, Indianapolis, IN 46202 (

Leslie M. Beitsch is a board member of PHAB and serves as a Deputy Secretary of an accredited state health department. The information contained in this article reflects the opinions of the authors and does not represent the official board policy of PHAB. There are no other conflicts of interest or sources of funding to disclose.

This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.

In recent years, several influential groups have described the need for public health to expand its role through collaborations with nontraditional public health entities.1–3 This need was driven by the increased understanding of the role that social determinants of health (SDH), such as education, housing, and the built environment, play on population health. Cross-sector collaborations between state and local public health agencies and entities involved in these activities have been proposed as a way to better address these SDH and improve health equity. This effort, called “Public Health 3.0,” specifically suggests that public health departments act as coordinators across these collaborators for their communities.

Increasing collaboration and organizing community efforts toward improved population health and health equity under Public Health 3.0 may create additional management, budgetary, and workforce demands.4 Given these additional agency pressures, there is an urgent need for public health leaders to be able to mobilize the frontline public health workforce and their collaborators to accomplish these objectives.3–7 The success of this new responsibility requires support from public health leaders and their ability to motivate their staff. A recent national survey of public health leaders found that 76% to 93% of supervisors and executives reported confidence in their ability to manage change within the agency8; however, it did not ask respondents how prepared they are for collaboration or how well they are currently managing change within or outside of their agencies. There have been numerous examples of public health partnering with various organizations including schools and hospitals as well as nontraditional partners outside the scope of health such as faith communities.9–13 Yet much of what has been studied about such collaborations preceded the Public Health 3.0 initiative. Recently, anecdotal reports have shared examples of Public Health 3.0 collaborations such as with a community health and literacy center in Philadelphia (the Live Well Allegheny Initiative), sponsored through a partnership between the city and the local children's hospital14 which includes collaboration between the health department, schools, restaurants, workplaces, and governmental agencies targeting chronic disease prevention1,15 Another example (California's Accountable Communities for Health) is a statewide initiative that includes a variety of partners and a unique funding model.1 Although anecdotal reports are informative and provide examples for other health departments, little is known about the general perception of the public health workforce about implementation of the Public Health 3.0 initiative or how well senior leaders and mid-level managers may be communicating the changes proposed by Public Health 3.0 within their agencies.

The purpose of this article is to describe the extent to which all public health workers, including frontline workers, supervisors, and executives, perceive the role of their agencies in Public Health 3.0. In addition, we examine whether differences exist between the perspectives of agency directors and frontline public health workers about the role of their agency in Public Health 3.0. To accomplish these goals, we utilize recently collected national data of public health workers' perceptions of how involved they believe their agency should be in several activities aligned with Public Health 3.0 including education, housing, transportation, and the built environment. Low perceptions of involvement or differences in perceptions by leadership status may have implications for public health's ability to meet the goals of Public Health 3.0 and may support leaders during this transition. Findings from this study will be of particular interest to the organizations supporting Public Health 3.0 and public health leaders.

Back to Top | Article Outline


Study design and population studied

This cross-sectional study considers governmental public health workers' perceptions of the role of their agencies in 2017. Overall, this study assesses 3 questions in 3 separate analyses. First, what are workers' perceptions of the involvement of their agencies in various activities that align with the Public Health 3.0 mission? Second, is there agreement about involvement between types of employees by their supervisory status? Third, is there agreement between state and local employees?

This study used 2017 data from the Public Health Workforce Interests and Needs Survey (PH WINS).16 PH WINS is administered by the Association of State and Territorial Health Officials (ASTHO) and surveys local and state public health employees about their educational background, job and workplace satisfaction, training needs, and intentions to leave their employment. The survey first began in 2014, and this is the second wave of data collection for the survey. Based on sampling and response, the survey is nationally representative of the state and local governmental public health workforce; however, no local health departments serving fewer than 25 000 people or with fewer than 25 employees were included in nationally representative samples.

Back to Top | Article Outline

Independent variables

The primary independent variable of interest was supervisory status (ie, nonsupervisory, supervisor, manager, or executive). This variable is used to examine concordance in perspectives between agency directors and individuals across each supervisory level. To identify the most senior leaders in an agency, a new variable “agency director” was generated from individuals who were both “executives” and indicated that their role was department/bureau director, deputy director, health officer, or public health agency director.

Other individual and agency characteristics were used as covariates in the analyses to account for other differences in responses. Individual respondent characteristics include age, gender, race/ethnicity, highest degree attained, having a formal public health education (at the bachelor's level or above), and role type. Survey respondents were asked to select their role type from a list of more than 60 roles. These included “administrative/staff,” “clinical and lab,” “public health sciences,” and “social services and other.” “Administrative/staff” includes roles such as attorney, business support, grant specialists, and human resources. “Clinical and lab” includes roles such as community health workers, laboratory workers, medical examiners, public health nurses, and physicians. “Public health sciences” includes roles such as epidemiologists, disease intervention specialists, environmental health workers, and health educators. “Social services and other” includes social workers and all other respondents. Individuals who identified their role as clerical personnel, custodian, or other (n = 10 890) or were part-time (n = 3324) were removed from the sample, as they are likely not in the position to carry out or influence Public Health 3.0 efforts in their agency. In addition, 315 individuals who responded that their role was department/bureau director, deputy director, health officer, or public health agency director but did not state that they were either managers or executives were removed, as this indicated that one of the questions was answered incorrectly. Finally, those missing key characteristics such as supervisory status were removed from the sample. Agency covariates include a categorical measure of size of the agency (ie, size of the population served by tertile [small, medium, large]), governance structure, and jurisdiction (state/local).

Back to Top | Article Outline

Dependent variables

The first set of dependent variables examined for the analysis was individual perceptions of how involved respondents believe their agency should be in various activities aligned with Public Health 3.0 (further referred to as involvement). These activities include the K-12 education system, economy, the built environment, housing, transportation, social connectedness, and health equity within their jurisdiction. Individuals were able to respond on a 4-point Likert scale from “not at all involved” to “very involved.” These variables were transformed into a binary indicator for any perceived involvement where “not at all” and “not very involved” were considered “little to no involvement” and “somewhat” to “very involved” were considered “involved.”

Concordance of involvement perceptions was calculated between agency directors and all other agency employees. Within each agency, a summary of perceived involvement by the collective agency directors was calculated by averaging the binary variable for involvement across the leaders in the agency. If more than 50% of the directors responded that their agency should be involved in that activity, the agency director average perception was considered “involved.” For each of the nonagency director respondents, concordance was calculated on the basis of their perceived involvement compared with the summary agency leadership involvement. For example, if 60% of the agency's directors thought that their agency should be involved, the agency director perception was involved. If one of the nondirectors from that agency also reported their agency should be involved, there was concordance.

Back to Top | Article Outline


Descriptive statistics were performed to summarize respondents included in the study. Differences in characteristics, perceptions of involvement, and concordance across supervisory levels were assessed using χ2 tests for all individual, job, and agency characteristics.

Logistic regression models were conducted to understand which characteristics are associated with perceived involvement in Public Health 3.0 activities. Individual models were conducted for each Public Health 3.0 activity at the individual respondent level. Supervisory status was the primary independent variable of interest, and all of the individual and agency characteristics described earlier were included as additional covariates in the models.

Concordance between employees and agency directors was modeled using a logistic regression at the individual level. Agency director responses were used to calculate the summary agency director involvement, and, ultimately, the concordance outcome variable but were then removed from the sample for this model. All individual and agency characteristics described earlier were included as covariates in the model.

All analyses were weighted using nationally representative and replication weights of the public health workforce provided by ASTHO and were conducted in Stata version 15 (College Station, Texas). This study was deemed nonhuman subjects research by the Indiana University institutional review board.

Back to Top | Article Outline


The 2017 PH WINS received 43 697 respondents. After excluding responses as noted in the methods, our sample size was 27 050. As a weighted sample, this represents 109 942 governmental public health workers. Of the weighted sample considered, 68% were nonsupervisors, 18.7% supervisors, 11.3% managers, and 2% executives (Table 1). Gender, age, education level, having a formal public health degree, role type, tenure in public health practice, agency jurisdiction, governance, and size all differed significantly by supervisory status. Age and number of years of service are reflective of supervisory roles; younger and less-experienced workers are less likely to be in supervisory roles, whereas older, more-experienced workers are more likely to be in higher leadership roles. A higher proportion of managers and executives have master's and doctoral degrees than those in other roles. A higher proportion of nonsupervisors and supervisors are in clinical and lab positions than managers and executives, and the majority of managers and executives are in public health sciences roles.



Forty-six state and 145 local agencies were examined in the current study determined by having responses to the survey from both agency directors and nonagency directors. This sample of just over 23 000 respondents (unweighted) was used for the concordance models. While the state sample had representation from most states, the local sample included a smaller proportion (5.7%) of the total population of local health departments in the country. Nearly 78% of the local agencies in the sample with both agency directors and nonagency director responses were in the largest tertile of local agencies, and 72.6% were from agencies with decentralized governance.

Back to Top | Article Outline

Individual perceptions of support of agency involvement

The most common Public Health 3.0 activity that the overall workforce feel their agency should be involved in is health equity (87.4%), followed by social connectedness (77.7%) (Figure 1). The least common activity in which individuals felt their agency should be involved was transportation (55.8%). In bivariate analyses, perceptions of involvement were significantly associated with supervisory level for all activities besides education (P = .12). Across all activities aside from health equity, agency directors most frequently believed their agency should be involved in each public health 3.0 activity and perceptions generally decreased with each lower supervisory level.



Multivariate logistic regression results showed significantly greater odds of perceived involvement for agency directors than nonsupervisors for all Public Health 3.0 activities, with the greatest magnitude of difference between agency directors and nonsupervisors being for the built environment (OR = 4.05, P < .001) (Table 2). Other executives and managers also showed greater odds of involvement for the economy, built environment, and health equity compared with nonsupervisors. Individual perceptions of supervisors were not significantly different from those of nonsupervisors for any Public Health 3.0 activities.



For at least 5 of the 7 Public Health 3.0 activities, having a public health degree, a master's or doctorate, and being black or African American were associated with greater odds of perceived involvement. Being male or working at a state health department was associated with lower odds of perceived involvement for each activity. When significant, Asian race, nonbinary or other gender, and centralized governance were associated with lower odds of perceived involvement than being white, female, and having decentralized governance, respectively.

Back to Top | Article Outline

Concordance in perceptions between agency directors and the general workforce

Figure 2 presents perspectives of workforce concordance with agency directors. Concordance differed significantly by supervisory status for health equity (P < .001), social connectedness (P = .03), education (P = .002), housing (P = .02), and the built environment (P < .001) in bivariate analyses. The highest proportion of concordance was between agency directors and other executives across all 3.0 activities. The second highest proportion of concordance with agency directors was among managers; however, for housing, concordance was second highest between supervisors and agency directors.



In multivariate logistic regression analyses, executives had greater odds of agreeing with their agency directors than nonsupervisors for the following activities: education (OR = 1.51, P = .003), housing (OR = 1.33, P = .02), social connectedness (OR = 1.40, P = .047), and health equity (OR = 1.64, P = .025) (Table 3). The only activity in which there was significantly different concordance between agency directors and managers compared with nonsupervisors was for activities focused on transportation (OR = 1.14, P = .01). Individuals with a public health degree were at significantly greater odds of concordance with directors than those without a public health degree with regard to the built environment (OR = 1.43, P < .001), transportation (OR = 1.20, P = .02), and social connectedness (OR = 1.17, P = .02). Across a majority of the 7 Public Health 3.0 activities, higher education and being black or African American were significantly associated with agreement with directors similar to the models that examined individual perceptions of involvement. Males and individuals working at a state agency were consistently significantly less likely to agree with their directors than female and local agency respondents. Across the models for each activity, being Asian and having nonadministrative roles were only sometimes significant. In models wherein they were significant, being Asian and having nonadministrative roles were associated with lower odds of agreement with directors.



Back to Top | Article Outline


Overall, more than half of the public health workforce believe their agency should be involved in various Public Health 3.0–related activities. Health equity is the most commonly supported activity, followed by social connectedness. This suggests that many public health employees are already in support of these activities. However, Public Health 3.0 activities that may be further from traditional public health work (ie, economy, transportation, and the built environment) may still need to garner support from the workforce before workers fully embrace new responsibilities in these areas or automatically think to include these activities in their ongoing interventions and other initiatives.

Generally, those who are in higher supervisory roles, have a public health degree, have a higher level of education, and are black or African American are more supportive of their agencies being involved in most Public Health 3.0 activities. Higher levels of support from individuals with higher-level degrees, individuals with formal public health education, and those in higher-level supervisory roles may be reflective of these individuals having more training on the importance and health impacts of social determinants related to these Public Health 3.0 activities and/or greater lived experience. Those individuals in higher-level supervisory roles may also be more aware of the bigger picture of the role of their agencies and thus are more supportive of these new 3.0 responsibilities. In a similar vein, state agencies tend to be much larger and are less involved in direct “boots-on-the-ground” work and interventions than local agencies, potentially making Public Health 3.0 activities more theoretical and less personal. This difference in size and focus of work may explain why state and centralized system employees tend to be less supportive of Public Health 3.0 activities than their local public health peers. The “boots-on-the-ground” perspective of local public health employees may translate into being more aware of the need or role of the Public Health 3.0 activities in supporting the communities they serve. However, less supportive perceptions of the activities among state respondents may be important, as many of the policies addressing efforts related to Public Health 3.0 activities may originate at the state level, especially within centralized systems.

Concordance in perceptions of involvement in 3.0 activities between the workforce and directors in an agency appears to be less consistent. Across the full workforce, less than 60% of the workforce agrees with its directors on the involvement of its agencies for transportation, housing, the built environment, the economy, and education. Other executive-level employees have greater odds of concordance with directors for education, housing, social connectedness, and health equity but not for other activities. Regarding transportation, managers have higher odds of concordance with senior leaders than nonsupervisors, but executive-level employees do not differ from nonsupervisors in terms of concordance with agency directors. Overall, concordance findings may suggest that while the agency directors are generally on board with Public Health 3.0 activities, the message is only being translated to those closest to them in the supervisory hierarchy (executive-level employees) and not for all types of activities. This may suggest the need for improved communication across silos about the potential value of Public Health 3.0 activities or enhanced education around the importance of Public Health 3.0 activities among the general public health workforce. Alternatively, the results may also reflect resistance to change regarding current roles and activities, posing a challenge in systems change management. Executives and agency leaders by virtue of lengthier experience may have witnessed firsthand the difficulties of meaningful community health status improvement and as a result are more willing to embrace newer models. Finally, differences by role type and supervisory status may reflect the current siloed public health approach or the narrow scope of nonagency directors.

The concordance results, if validated by further research, may represent the most important findings in this study. Although not vast, they illustrate the gulf between viewpoints of where senior policy makers are headed and perspectives of other staff members. Contemplating the public health practice of the future, how will visionary leaders effectively translate their concepts to the workforce that will be entrusted with 3.0 implementation? Although staff with higher education and public health degrees appear supportive, have their education and preparation provided them with tools for successful cross-sectoral collaboration? Notably, most directors and staff members share support for the major elements of Public Health 3.0, providing a solid foundation for a clarion call to action.

This study has several notable limitations. First, analyses are cross-sectional in nature (2017 only) and cannot assess any causal relationship between leadership status and perceptions of Public Health 3.0 activities. Second, many analytical models and comparisons were examined in this study. Conducting a high number of comparisons increases the risk for type I error or finding significant relationships by chance when such differences may not in fact exist. However, the relative consistency in significance and direction of coefficients across models suggests that the significant differences presented are likely true differences and not merely random events. Third, our analysis considered concordance, which could include either agreement that the agency should be involved or agreement that the agency should not be involved in a Public Health 3.0 activity. While concordance agreement findings should be interpreted with caution, it is important to note that based on individual perception analyses, the majority of directors supported 3.0 activity involvement. Finally, while most states have agency leader and workforce representation in the survey, agencies with both respondent types at the local level are much more rare, which limited the number of agencies represented and thus the generalizability of findings. The local agencies included in this study are generally large and have decentralized governance. As a relatively early study of Public Health 3.0 perceptions, we are unsure how larger, decentralized local agency respondents may differ from respondents from smaller, centralized agencies and therefore how our results may differ had there been more representation in the sample from such agencies.

Back to Top | Article Outline

Implications for Policy & Practice

  • This study is the first to consider the public health workforce's perceptions of support and involvement in various Public Health 3.0–related activities.
  • There is general support for most 3.0 activities, although gaps in support may be present within the levels of supervisory status, gender, race/ethnicity, educational background, jurisdiction, and governance structure.
  • Despite concordance on involvement for 3.0 activities generally, involvement typically does not translate throughout the agency from senior leaders to the entire workforce.
  • These findings may facilitate public health agency leaders understanding of perceptions of the workforce and their support of the 3.0 activities. Greater insight may prove useful for informing strategies around leader communication of such ideas and for ensuring workforce training needs are met regarding social determinants of health and Public Health 3.0 activities.
Back to Top | Article Outline


1. US Department of Health and Human Services. Public Health 3.0: a call to action to create a 21st century public health infrastructure. Published 2016. Accessed February 15, 2018.
2. National Association of County and City Health Officials. Public Health 3.0 Issue Brief. Published 2016. Accessed February 15, 2018.
3. DeSalvo KB, O'Carroll PW, Koo D, Auerbach JM, Monroe JA. Public Health 3.0: time for an upgrade. Am J Public Health. 2016;106(4):621–622.
4. DeSalvo KB, Wang YC, Harris A, Auerbach J, Koo D, O'Carroll P. Public Health 3.0: a call to action for public health to meet the challenges of the 21st century. Prev Chronic Dis. 2017;14:E78.
5. Fraser M, Castrucci B, Harper E. Public health leadership and management in the era of Public Health 3.0. J Public Health Manag Pract. 2017;23(1):90–92.
6. Plough AL. Building a culture of health: challenges for the public health workforce. Am J Prev Med. 2014;47(5)(suppl 3):S388–S390.
7. Johnson JH Jr, Sabol BJ, Baker EL Jr. The crucible of public health practice: major trends shaping the design of the Management Academy for Public Health. J Public Health Manag Pract. 2006;12(5):419–425.
8. Kornfeld J, Sznol J, Lee D. Characterizing the business skills of the public health workforce: practical implications from the Public Health Workforce Interests and Needs Survey (PH WINS). J Public Health Manag Pract. 2015;21(suppl 6):S159–S167.
9. Newman SJ, Ye J, Leep CJ, Hasbrouck L, Zometa C. Assessment of staffing, services, and partnerships of local health departments—United States, 2015. MMWR Morb Mortal Wkly Rep. 2016;65(25):646–649.
10. Halverson PK, Mays GP, Kaluzny AD. Working together? Organizational and market determinants of collaboration between public health and medical care providers. Am J Public Health. 2000;90(12):1913–1916.
11. Vest JR, Caine V, Harris LE, Watson DP, Menachemi N, Halverson PK. Fostering local health department and health system collaboration through case conferences for at-risk and vulnerable populations. Am J Public Health. 2018;108(5):649–651.
12. Mays GP, Smith SA, Scutchfield FD, Bhandari M. Understanding the organization of public health delivery systems: an empirical typology. Milbank Q. 2010;88(1):81–111.
13. Barnes P, Curtis A. A national examination of LHD partnerships with faith communities in the U.S. J Public Health Manag Pract. 2009;15(3):253–263.
14. Devietti E. Public Health 3.0 in South Philadelphia: the Community Health and Literacy Center. Web site. Published December 22, 2016. Accessed February 15, 2018.
15. Live Well Allegheny. Live Well Allegheny. Accessed February 15, 2018.
16. Leider JP, Pineau V, Bogaert K, Ma Q. The methods of PH WINS 2017: approaches to refreshing nationally-representative state-level estimates and creating nationally-representative local-level estimates of public health workforce interests and needs. J Public Health Manag Pract. 2019;25(suppl 2):S49–S57.

leadership; Public Health 3.0; public health workforce; training needs

Copyright © 2019 Wolters Kluwer Health, Inc. All rights reserved.