Each trainee accepted into the TUTOR-PHC program remains in the program for one year. Concurrently, most of the trainees attend a graduate program at their home university. TUTOR-PHC provides supplementary training equivalent to one full graduate course. Most receive a TUTOR-PHC fellowship at CIHR levels congruent with their experience.
All aspects of the TUTOR-PHC program are interdisciplinary in nature, and they focus on three components: (1) a three-day on-site symposium, which is hosted on a rotating basis by each of the founding Canadian universities, (2) four online workshops, lasting three weeks each, and (3) two online interdisciplinary discussion groups, lasting seven weeks each. After the symposium, for which all participants are in one location, the online components allow continuation of the program for participants who are scattered across Canada. Trainees participate in forming the curriculum by completing a needs assessment on admission to the program. These needs assessments identify potential topics for the symposium workshops and the online portion of the program. List 1 provides a complete list of workshops offered.
The three-day on-site symposium kicks off the yearlong program. It provides the opportunity for the trainees to get to know each other, both permitting an introduction of topics and experiences that are most suited to face-to-face interaction and providing a foundation for the trainees to interact later in the online segments of the program. Interdisciplinary discussion groups are a key component of the symposium, in which participants are asked to contribute feedback on research proposals from the perspective of their own PHC discipline. The symposium also serves to introduce and define PHC and the function of interdisciplinary teams through the conduct of interactive, small-group exercises and six methods-based workshops (two that are chosen through needs assessment and four that are mandatory; List 1). As a preamble to this smorgasbord of methods workshops, the mentors present succinct (five-minute) introductions (called “snappers”) about the various methodologies to all trainees. All workshops are facilitated by program mentors, who ensure experiential learning through interaction and practice.
After the trainees return to their universities, they participate in the two online workshops selected via the trainees' needs assessments. The purpose of these workshops is to fill in gaps in research methods knowledge and skills that are highly relevant to PHC. These workshops have a three-week, modular format, are facilitated by experienced PHC researchers, and cover theory and practice (e.g., an evaluation of PHC reform and an overview of qualitative research methods) (List 1).
Online interdisciplinary discussion groups
The approach to interdisciplinary discussion groups has been intentionally crafted to foster interdisciplinary research team building. Each group is composed of six or seven trainees from different disciplines who participate in asynchronous discussions that allow for the various time zones in which participants live and the frequent time challenges for practicing clinicians. The groups are moderated by program mentors, although trainees are encouraged to lead the discussions to build their skills in facilitating an interdisciplinary group. This online experience comprises two overarching tasks. The first of these tasks has two parts: The trainee provides feedback on his or her peers' research project from the perspective of the trainee's own discipline, and then the trainee receives feedback on his or her own project from the perspective of peers representing at least four other disciplines. This input can reframe the research projects and mold them into truly interdisciplinary undertakings. The second of these tasks requires each group to create a team grant proposal. In this exercise, each trainee leads the group in creating a different part of an interdisciplinary PHC proposal (e.g., research question, sample, methods, or knowledge translation). The realities of group process, such as time pressures, team conflicts, effective use of member strengths, and the effort to create a product that can be endorsed by all team members, are some of the challenges trainees must face. The online nature of the exercise also prepares trainees for the realities of leading a geographically dispersed research team.
Guidance during the TUTOR-PHC program
Each of the trainees has a supervisor from his or her home institution, usually his or her graduate studies thesis supervisor. Each trainee's supervisor attends the symposium and participates in the online interdisciplinary discussion groups. At the symposium, supervisors attend a facilitated workshop that is aimed at discussing issues related to interdisciplinary graduate supervision and research team leadership. The interdisciplinary nature of the program draws supervisors—who are faculty members at various stages of their careers—into PHC research and gives them the knowledge and skills needed to weave PHC into their research agendas. Thus, the TUTOR-PHC program builds PHC research capacity at the trainee level, as well as at the faculty level, through supervisor participation. Collaboration among PHC-relevant disciplines and across geographic distances is also enhanced.
Trainees are also guided by mentors; each trainee chooses a mentor from among the program's pool of nationally recognized faculty. This part of the program allows each trainee access to an experienced interdisciplinary PHC researcher who provides support during the program and who is available after the program for career advice, feedback on proposals and/or papers, advice on project design and methodology, and/or collaboration on research.
Evaluation, Evolution, and Outcomes
TUTOR-PHC has graduated 77 trainees from 14 disciplines. Seventy-four supervisors have participated, of whom 15 were program mentors. Each year, nearly four times as many applicants seek TUTOR-PHC trainee positions as can be accepted (i.e., approximately 50 applicants for approximately 14 positions per year).
Twenty-two educational products have been created for TUTOR-PHC, including 11 online research workshops with train-the-trainer manuals. A complete list of these workshops appears in List 1. The manuals are available at the TUTOR-PHC Web site (www.uwo.ca/fammed/csfm/tutor-phc).
Program graduates have received questionnaires after their year in TUTOR-PHC and yearly from 2005 on. The evaluation questionnaires revealed a high level of productivity among the 77 TUTOR-PHC graduates, who are at various stages of their careers. The graduates have published 367 peer-reviewed papers and had made 675 conference presentations as of August 2008. Trainees have produced many grant proposals during or immediately after their year in TUTOR-PHC. For example, in the years 2007 and 2008 alone, TUTOR-PHC fellows received funding for 125 grant proposals. A high proportion of TUTOR-PHC fellows now hold faculty appointments; two trainees have returned as supervisors in the TUTOR-PHC program, and two have been invited to join the mentor team. One graduate now holds the only Primary Care Applied Chair in Health Services and Policy Research, which is funded by the Canadian Institute for Health Services and Policy Research, and another graduate is now director of evaluation for the Pharmaceutical Services Division of the British Columbia Ministry of Health Services. Other positions currently held by TUTOR-PHC graduates are those of principal scientist, C.T. Lamont Primary Health Care Research Centre, Elizabeth Bruyère Research Institute (Ottawa, Ontario, Canada); clinician scientist, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto (Toronto, Ontario, Canada); and head, Division of Preventive Dentistry and Oral Health Promotion, Dental Clinical Sciences, Dalhousie University (Halifax, Nova Scotia, Canada). These outcomes indicate both the selection of highly productive trainees and the impact of the TUTOR-PHC program.
Several features of the TUTOR-PHC program have received very high ratings by trainee participants, among them the interdisciplinary discussion groups. Participants were surprised at the varied perspectives that emerged with respect to the same research topic. After the symposium, the trainees engaged in online interdisciplinary discussion groups (six to seven trainees from different disciplines per group). Projects can range from clinical research (e.g., evaluating the relationship between diabetic nephropathy and related risk factors and other clinical variables in a cohort of primary care patients with type 2 diabetes) to health services research (e.g., factors associated with adolescent family physician utilization) to community interventions (e.g., cardiovascular health promotion in communities) to knowledge-translation-focused research (e.g., knowledge translation practices within multidisciplinary health care teams). Each trainee was given one week to facilitate a discussion on his or her research (proposed or under way). The trainees presented their research and responded to the feedback and/or queries from their interdisciplinary colleagues. The trainees thought that this experience was unique and invaluable. As one trainee stated, “I was amazed at the high level [of discussion] and [the] interesting perspectives provided by the cross-disciplinary exchange! Thanks for the valuable insights.” Another trainee said, “I have spent the most exciting week of my junior research career!”
The trainees considered the creation of an interdisciplinary research team to produce a grant proposal to be a most valuable, albeit difficult, exercise. For example, in 2008, the trainees received a call for proposals based on a CIHR call for Operating Grants on Childhood Obesity Prevention and Treatment. The trainees' task is to create a proposal that is interdisciplinary, preferably of a mixed-method design, and specific to PHC.
Many trainees commented on the evaluation of this task. A 2006 graduate said, “It wasn't easy, but I think it gave us some real-life insights into the practicalities of working as a team and trying to consider everyone's varied agendas, backgrounds, and strengths.”
A 2007 graduate said,
We were provided with an opportunity to delve as [deeply] as we wanted into a topic that was not clearly defined for us. As such, we were able to go through the problem-solving cycle that all researchers go through—identifying the problem/research question before proceeding further with the proposal.
A 2005 graduate commented,
The application of research knowledge gained throughout the course allowed for consolidation of learning… . The group and facilitators [also] provided additional references for future learning. I was very fortunate [in] the outstanding communication abilities of my group, and many [concepts] were clarified through the RFP process.
A most rewarding aspect of TUTOR-PHC is the high proportion (75%) of clinician–researchers from a variety of disciplines in the trainee pool. As a result of the evaluation of and reflection on the program, several noteworthy changes enhanced the original program. One of these changes was the addition of other disciplines to the original five from which the coinvestigator team was derived (we added pharmacy, sociology, education, and health services research); moreover, among the trainees, we added the disciplines of sociology, physiotherapy, occupational therapy, philosophy, anthropology, dietetics, and community dentistry. Another change was the addition of an assessment of trainees' needs, which has allowed TUTOR-PHC to be more responsive to individual needs. In particular, with regard to workshops, TUTOR-PHC enacted a learner-centered approach by conducting a needs assessment of trainees that led to a relevant list of potential workshops and by permitting trainees to choose from this tailored list. A further change, which took place during implementation, was enacted to ensure that the main disciplines were represented in each cohort of fellows; we stratified all applicants into the categories of family medicine, nursing, epidemiology, psychology, social work, and other. This arrangement is now TUTOR-PHC selection policy.
Discussion of Interdisciplinary Training in PHC Research and Lessons Learned
The TUTOR-PHC training program on interdisciplinary research had many strengths. It attracted a large pool of applicants every year. Each cohort of trainees had an acceptable mix of disciplines, as mandated by the selection process. Trainees have been exposed to multiple research methods during highly rated, succinct presentations. The interdisciplinary concepts and experiences produced rave responses from trainees. The productivity outcomes of trainees were impressive.
TUTOR-PHC has had several specific curricular successes. One successful aspect of the program is the process that combines readings, discussion, and experiential learning within each three-week online workshop. A second is the enacting of the principle of interdisciplinarity by placement of trainees from various disciplines into each discussion group. A third successful aspect of TUTOR-PHC is the structure and process created by the mentors for the online discussion groups, including the request for proposals to which the interdisciplinary team of trainees is required to respond by creating an interdisciplinary grant proposal. In a fourth success, experienced mentors reflect, as part of the symposium, on what they bring to an interdisciplinary research team from their discipline and from their personal skills and experience (this part of the symposium is highly rated, and it provokes much discussion and reflection). A fifth successful aspect is the requirement that the trainee's graduate program supervisor attend the symposium to experience the interdisciplinary and PHC learning. A sixth successful aspect is the exposure of trainees and supervisors to peers from different disciplines, in the retreat-like setting of the symposium, which has inspired and built networks for future collaborations, just as it was designed to do. To date, we have seen the development of several teams that are now pursuing interdisciplinary PHC research.
The TUTOR-PHC program faced, and met, at least two significant structural challenges. The first of these challenges—the discovery that the applicants and trainees had a more senior status than was anticipated—was a challenge with a silver lining. The positive aspect of this situation was that TUTOR-PHC became more focused on training future leaders (midcareer professionals, postdoctoral fellows, and PhD students) and not so focused on training undergraduate students, residents, and MA/MS students. The negative side of this situation was that the financial support needed for these fellows was higher than anticipated, and thus fewer trainees could be funded. TUTOR-PHC's response to this challenge was to invite some trainees to participate without a fellowship; the trainees' acceptance of this invitation enabled TUTOR-PHC to exceed the projected number of trainees. The second of the challenges was the ongoing effort to maintain the interdisciplinary mix of trainees. Recruitment strategies were refined and enhanced during the first two years of the program to include more systematic advertising in a broader range of disciplines, better use of the mentors' professional contacts, and more frequent repetition of the announcements.
Every yearlong course of TUTOR-PHC presented challenges that we addressed, over time, which created a more balanced and more learner-centered experience. Although the interdisciplinary experiences have been highly rated by trainees, the amount of delicate facilitation needed to move trainees to a point of being prepared to contribute to an interdisciplinary research team was unexpected. To prepare each trainee to constructively bring his or her discipline's perspective to a team meeting, mentors modeled their disciplinary contributions. Mentors imparted their tacit knowledge, which is based on their many years of experience, through a variety of exercises that they conducted before trainees were ready to participate meaningfully in their interdisciplinary discussion groups. To prepare the interdisciplinary team of trainees to write a grant proposal together, the mentors worked to create a request for proposal that was challenging but not overwhelming; this process took several years.
Several value-added features are noteworthy. As TUTOR-PHC mentors have reflected on the educational approaches in the program, it has become clear that TUTOR-PHC has surpassed the goal of teaching and learning research skills and the theoretical knowledge of methods and of the nature of PHC. The new level or goal reached is the imparting of the tacit knowledge of the experienced mentors to the trainees—that is, the “how-to's” of combining research methods, of being a researcher in an interdisciplinary team, and of synthesizing one's personal qualities with one's research skills and knowledge to become a truly collaborative researcher.11,12 In addition, collaborations among supervisors and mentors who met during the TUTOR-PHC program have been a benefit. This informal networking has spawned PHC research initiatives that are more representative nationally as well as being inclusive of a wider range of disciplines. Moreover, the addition of international trainees from 2006 through 2008 widened the perspectives of the Canadian participants and provided an opportunity to disseminate Canadian PHC research to international colleagues.
In summary, then, TUTOR-PHC has succeeded, but not without considerable reflection and continued effort. It has attracted trainees from a rich mix of disciplines and offered them a transformative opportunity to become collaborative leaders of future PHC research.
The authors would like to thank Sandi Richard-Mohamed of the TUTOR-PHC staff for her contributions to the planning and successful implementation of the program.
The Canadian Institutes of Health Research funded the Transdisciplinary Understanding and Training on Research–Primary Health Care (TUTOR-PHC) training through the Strategic Training Initiative in Health Research, and Dr. Stewart is funded by the Dr. Brian W. Gilbert Canada Research Chair.
2Perlin JB, Kolodner RM, Roswell RH. The Veterans Health Administration: Quality, value, accountability, and information as transforming strategies for patient-centered care. Healthc Pap. 2005;5(4):10–24.
4Starfield B. Primary Care: Balancing Health Needs, Services and Technology. New York, NY: Oxford University Press; 1998.
5Nutting PA. Practice-based research networks: Building the infrastructure of primary care research. J Fam Pract. 1996;42:199–203.
7Green LA, Fryer GE, Yawn BP, Lanier D, Dovey SM. The ecology of medical care revisited. N Engl J Med. 2001;344:2021–2025.
8McWhinney IR. A Textbook of Family Medicine. 2nd ed. Oxford, UK: Oxford University Press; 1997.
9Mikail SF, McGrath P, Service J. Strengthening Primary Care: The Contribution of the Science and Practice of Psychology. Ottawa, Ontario, Canada: Canadian Psychological Association; 2000.
10Russell G, Geneau R, Johnston S, Liddy C, Hogg W, Hogan K. Mapping the Future of Primary Health Care Research in Canada. A Report to the Canadian Health Services Research Foundation. Ottawa, Ontario, Canada: Canadian Health Services Research Foundation; 2007.
11Nutley S, Walter I, Davies H. From knowing to doing. Evaluation. 2003;9:125–148.
© 2010 Association of American Medical Colleges
12Lange E. Transformative and restorative learning: A vital dialectic for sustainable societies. Adult Educ Q. 2004;54:121–139.