Harris, Paul A. PhD; Scott, Kirstin W. MPH; Lebo, Laurie PhD; Hassan, NikNik; Lightner, Chad; Pulley, Jill MBA
Challenges to recruiting participants for research studies obstruct the progress of clinical and translational research,1 slowing the pace of research, frustrating investigators and participants, resulting in statistics too weak to support efficacy or safety conclusions, and possibly exposing participants to unnecessary risks with no compensatory societal benefit.2 Despite campaigns to raise the rates of enrollment and retention in research studies, approximately three-fourths of the public report having little or no knowledge about the clinical research enterprise and how to participate.3 Further, only an estimated 2% of the U.S. population participates in clinical research each year.4
In sharp contrast, 83% of Internet users have searched online for medical information, with 66% seeking information on specific diseases or medical problems.5 ClinicalTrials.gov, the U.S. Library of Medicine's registry of over 110,000 clinical trials in 174 countries (created in 2000 in response to the 1997 FDA Modernization Act), reports over 65,000 visitors each day, revealing the public's interest in accessing information about clinical trials.6,7 Potential participants, however, face difficulties in finding relevant information on specific research studies. Many are simply unaware of the available resources,8 and those who have found the resources may lack familiarity with the complex medical terminology necessary to understand the purpose and scope of many research studies.9
Study recruitment is not only of interest for the public sector but is also a necessity for research teams at academic medical centers. In 2008, motivated by, among other things, these challenges to recruitment, the Clinical and Translational Science Awards (CTSA) consortium established a framework for what would eventually be five strategic goals deemed necessary to set a national research agenda and guide consortium-wide activities.10 The stated mission of the CTSA National Clinical and Translational Research Capability Strategic Goals is to improve all processes related to the development, approval, activation, enrollment, and completion of clinical trials.11
A Novel Recruitment Model for the CTSA Consortium
Recruitment registries have traditionally been local, connecting researchers at particular institutions with participants from the surrounding communities,12–15 or disease-specific, encouraging individuals with certain health conditions to participate in clinical research.16–20 Some registries are developed by academic medical centers; others are commercial ventures.
We proposed ResearchMatch as the first registry to support research teams across the national CTSA consortium and to benefit all U.S. residents regardless of medical condition. Vetted by the CTSA Informatics Key Function Committee and approved for supplemental funding by the National Institutes of Health's National Center for Research Resources, the project was launched in December 2008. We convened a group of 43 regulatory, recruitment, and informatics experts from across the CTSA consortium to serve as key informants in defining ResearchMatch's design requirements, data confidentiality framework, and governance model.
In devising ResearchMatch, our primary considerations were generalizability and equitable access for all participants. Consequently, the registry's design is institution- and disease-neutral, allowing anyone residing in the United States to register as a potential participant. The registry is available at no cost to volunteers and also to researchers at CTSA institutions that have joined the ResearchMatch network.
Another key consideration was the protection of volunteers' contact information and health data. We devised a clearinghouse model that blocks identifying information on a researcher's screen until the volunteer specifically gives approval to be contacted for a specific study. Even after receiving such approval, researchers using ResearchMatch must agree to treat all identifying information as confidential.
ResearchMatch was developed and is hosted at Vanderbilt University. Vanderbilt's institutional review board (IRB) provides human subjects protection oversight for the overall project; specific studies recruiting through ResearchMatch must receive approval from their own IRBs.
Because individual CTSAs generally include a collaborating group of hospitals and academic medical centers, we designed ResearchMatch to accommodate researchers from any institution associated with an award, as long as that institution joins the ResearchMatch network. Joining the network requires signing a legal document of participation (the Master Institutional Registry Agreement) and assigning at least one institutional liaison (see below) to coordinate the local IRB's involvement and facilitate researchers' and participants' awareness and engagement.
The two primary stakeholders for ResearchMatch are the study volunteers and the researchers seeking study participants. Given our objective to create registry access for any researcher at any CTSA institution, we recognized the need for a third stakeholder, the institutional liaison, who monitors and manages local requests to access ResearchMatch. The following definitions clarify the stakeholders' roles and responsibilities.
* Volunteers are individuals who have an interest in being considered for participation in research studies or trials. All U.S. residents over the age of 18 are eligible to register themselves or children and disabled or elderly family members for whom they are parent, guardian, or caretaker.
* Researchers are employees or affiliated staff at academic medical centers or hospitals that have joined the ResearchMatch network. Once registered as a researcher, a principal investigator or designated research study coordinator may search the registry to find volunteers matching his or her study's inclusion/exclusion requirements.
* Institutional liaisons are individuals appointed by participating institutions to authorize local research teams to use ResearchMatch. Liaisons typically have a strong interest in community engagement and study recruitment. They also maintain familiarity with their IRBs' regulatory procedures and have access to the IRBs' approval letters and study status information. They actively engage with the registry oversight team at Vanderbilt University via biweekly conference calls and a liaison e-mail listserv. Liaisons may also participate in the local marketing and promotion of ResearchMatch.
Implementation of ResearchMatch
ResearchMatch's software application and back-end infrastructure are built on a PHP and MySQL technology framework.21,22 All data are securely stored on Web servers maintained within the Vanderbilt University firewall. All research subject recruitment data sent between Web server and browsers are encrypted using Secure Sockets Layer protection. Furthermore, all identifiable health and contact information is stored within the database in encrypted format.
Volunteers wishing to participate in studies and trials may register at the ResearchMatch Web site (www.researchmatch.org). The registration process takes approximately 5 to 10 minutes. Volunteers must first review and accept IRB-approved consent language. After creating a unique username and password, they provide contact (name, address, phone, e-mail) and demographic (date of birth, height, weight, gender, race, ethnicity, tobacco use, multiple birth status) information. Age, body mass index, and travel distance to participating institutions are automatically calculated from these data.
Volunteers then provide details about their medical conditions and current medications. If a volunteer has been diagnosed with a medical condition, he or she types a description (e.g., “high blood pressure,” “Parkinson disease”) into a text box, triggering an algorithm that matches text input to diseases and conditions described in the Unified Medical Language System (UMLS) metathesaurus.23 If an exact match is not found, the volunteer is presented with suggestions based on synonymy and partial key word matching. The volunteer may enter as many conditions as applicable. The volunteer then provides information on prescription and over-the-counter medication following a similar process. All entries are recorded using standardized UMLS coding terminology. This mapping of text to UMLS atomic unique identifiers and concept unique identifiers is essential so that researchers, whose technical terminology may differ from volunteers' lay language (e.g., “hypertension” versus “high blood pressure”), can still find matches.
Finally, volunteers indicate their travel preferences (e.g., “only contact me for studies requiring travel <50 miles”). Although ResearchMatch allows volunteers (and researchers) to specify acceptable distances for studies that require travel, it does not preclude volunteers from participating in behavioral survey studies that do not require travel or rare disease studies that typically enroll participants who travel great distances. Volunteers may also suggest quality improvement ideas for the ResearchMatch registration process. They receive e-mail confirmation of their registration and can access their ResearchMatch profiles to modify or update information at any time by logging into the site. The system logs usage by volunteers; it contacts volunteers who have not logged in for 12 months to ensure continued interest and up-to-date contact, demographic, and health information.
Researchers from any participating institution may use ResearchMatch to recruit study participants. Researchers must first agree to ResearchMatch's rules of use, including maintaining volunteers' confidentiality and stipulating that all activity will be approved by local IRBs. After creating a ResearchMatch profile (contact information plus username/password), the researcher must electronically submit an IRB approval letter for at least one actively recruiting study.
Researchers' access requests are automatically routed to the appropriate institutional liaisons, who confirm the requests' legitimacy and accuracy using local IRB approval letters. Once access is approved, the liaison sets an access expiration date that corresponds to the study's local IRB expiration date; the liaison can extend the access expiration date on receiving proof that the local IRB has extended its approval. ResearchMatch allows more than one authorized researcher to access the same protocol (e.g., a principal investigator plus multiple study coordinators). Access by other researchers in the same study requires permission from the principal investigator and the institutional liaison.
Researchers may request “feasibility-only” access without submitting active IRB study documentation if they wish to determine the approximate number of ResearchMatch volunteers who meet theoretical study requirements. Generally used to generate study hypotheses or to determine the usefulness of ResearchMatch for a particular study, feasibility-only access does not permit contact with volunteers.
Matching researchers and volunteers
Once their access requests have been authenticated and approved, researchers may recruit potential study participants. ResearchMatch's intuitive interface lets researchers filter the list of volunteers by specifying one or more of the following criteria: geographical constraint (by maximum distance from one's institution and/or state of residency), demographic data (age, height, weight, body mass index, gender, race, ethnicity, tobacco use, multiple birth status), medical conditions (by choosing volunteers who reported no medical conditions or by using text strings, which undergo the same process of being matched to terminology in the UMLS metathesaurus), and medications (similar in process to medical conditions). They may use clustering of conditions and Boolean logic when specifying filter criteria (e.g., [myocardial infarction OR congestive heart failure] AND [asthma] BUT NOT [prostate cancer]). Researchers may save the filtering criteria for repeated use within the same study.
The search module systematically narrows the pool and displays a deidentified list of matched volunteers. Researchers may examine each deidentified health profile to further refine their lists. Once a researcher has a final list, ResearchMatch sends each volunteer an e-mail, which contains IRB-approved language notifying them that a researcher at a named institution believes a particular study might be of interest to them. The e-mail notification asks the volunteers to indicate, by clicking on hypertext links, whether or not they are interested in being contacted with further information about the research study. When a volunteer indicates such an interest, ResearchMatch notifies the researcher. If the volunteer indicates no interest (by clicking “No” or by taking no action), ResearchMatch maintains the volunteer's anonymity and logs the response. Volunteers who click “No” are presented with a list of options through which they may delineate the reasons for their lack of interest. Researchers may also set ResearchMatch to automatically contact new (or updating) volunteer registrants who match the researcher's filtering criteria. They then receive notifications when new “Yes” volunteers are found. Researchers may access a study-specific ResearchMatch dashboard to observe general response trends to their recruitment e-mails.
Researchers who receive notification of an interested volunteer may access the study-specific dashboard to see the volunteer's contact information. They may then follow up by contacting interested volunteers by e-mail, phone, or surface mail. Further steps, such as study education and consent processes, are performed outside the purview of ResearchMatch. Researchers are encouraged, though, to use their study-specific dashboard to track the status of interested volunteers as they are contacted and then enrolled or deemed ineligible for a study. This tracking mechanism is provided as a service to research teams and also serves as the primary method for ResearchMatch to collect enrollment statistics for volunteers.
ResearchMatch's First 19 Months
In the 19 months following ResearchMatch's launch on November 10, 2009, 15,871 volunteers registered at the site. With the exception of several jumps in registration that followed large-scale press releases and registry announcements, ResearchMatch has steadily grown at a rate of approximately 21 new volunteers per day (Figure 1). Of the 15,871 registered volunteers as of June 1, 2011, 14,707 (92.7%) registered themselves and 1,164 (7.3%) were registered by a parent or guardian. Table 1 provides descriptive data for the volunteer population. Volunteers from all 50 states have registered, but regional rates are heavily influenced by the outreach and awareness campaigns conducted by participating institutions. States with the most volunteers are Tennessee (17.0% of ResearchMatch's 15,871 volunteers), Ohio (14.7%), New York (8.1%), Texas (7.6%), Alabama (6.2%), North Carolina (4.8%), Oregon (3.9%), Illinois (3.5%), Minnesota (3.4%), and California (2.8%).
We delayed the release of the researchers' search and contact tools by approximately four months to allow time to form a critical mass of volunteers. Since March 2009, the number of researchers using ResearchMatch has steadily increased (Figure 1), with 751 researchers registering from 61 participating institutions. Of those, 511 have full access for searching and contacting volunteers for a total of 540 specific studies, and 240 have limited, feasibility-only access.
When researchers register for study recruitment access, they provide basic information regarding their study, including protocol type and population of interest (adult, pediatric, or both). Table 2 breaks down the 540 studies by protocol type. Roughly half (55%) of the studies using ResearchMatch are clinical trials. Table 3 breaks down the studies by population of interest.
During the first 19 months of ResearchMatch's operation, researchers sent 68,673 e-mails to 13,462 volunteers. Some research teams surgically filtered their lists before sending the bulk messages, whereas others cast wider nets, assuming that the volunteers' response patterns would compensate for a lack of specificity. Figure 2 plots the total number of volunteers contacted against the number of volunteers who responded with interest for each individual study. The positive response rate appears linear, with approximately one of every five contacted volunteers expressing interest. Tables 2 and 3 show numbers of contacts, interested responses, and enrollment categorized by study type and population of interest.
Approximately 7.3% of contacted volunteers clicked the “No” option, actively indicating a lack of interest in the studies laid out in the bulk e-mails they received. Reasons they gave for nonparticipation included “I do not think I meet the requirements for this study” (3.8% of all contacted volunteers), “I am not interested in this research study” (1.1%), and “I do not have time to get involved” (0.6%). Other common reasons, given as free-text feedback, included concerns about distance, recent changes in health status (often pregnancy), and commitments to participate in other, concurrent studies. Research teams have access to this feedback to help them improve their volunteer-selection filters and compose more effective study advertisement language.
Analysis, Limitations, and Projected Work
Subscribing to the philosophy that “used systems get better,” we constantly evaluate ResearchMatch and evolve it to better serve the needs of all stakeholders. Volunteers, researchers, and liaisons can, via e-mail, submit questions, problems, and suggestions; the ResearchMatch team reviews and logs these submissions for immediate or future action. In this section, we analyze the experience gained in building and operating ResearchMatch to date, as well as plans for growing and evolving the project for the future.
Volunteer population diversity
ResearchMatch has attracted more than 15,800 volunteers from all 50 states. Racial and ethnic balances are important considerations for a national recruitment registry. In ResearchMatch's volunteer pool, relative to the national census, whites are overrepresented (81.2% ResearchMatch versus 75.1% U.S.), whereas African Americans (9.9% versus 12.3%) and Hispanic/Latinos (4.7% versus 12.5%) are underrepresented.24 The gender gap is even larger: Females are clearly overrepresented (72.7% versus 50.9%).24
Given our previous experience with Vanderbilt's local Web-based recruitment registry, we did not find these gaps surprising, but we think they are important and warrant further exploration.15 We believe that exploring alternative ways to promote ResearchMatch in diverse racial and ethnic communities, especially in collaboration with the CTSA's community engagement and communications committees, can help narrow these gaps. We are also considering a Spanish-language version of ResearchMatch. Although promotion and the development of additional tools may help, we anticipate that racial and ethnic gaps may always exist because of well-documented issues of socioeconomic disparity, Web-based recruitment, and self-reporting biases.25–28 Still, we look forward to leveraging the recruiting expertise of many of our 141 institutional liaisons and to devising and testing recruitment plans that reach diverse geographic and cultural environments.
Volunteer population quantity
ResearchMatch's single largest limitation at the end of 19 months of operation is the relatively small pool of volunteers. The registry currently has more than 16,000 volunteers, but this is a minute fraction of the U.S. population. Although all 50 states are represented, 74% of the volunteers reside in only 10 states; 25 states have fewer than 100 volunteers each. This heterogeneity is best explained by the variability of effort that local liaisons expend in marketing and raising awareness of ResearchMatch within their communities.
A registry is effective only if stakeholders know and use the system, so we have enlisted the liaisons to create and share low-cost marketing tools for local advertising of ResearchMatch. These tools have included participating in local health fairs, advertising on public video displays around medical center campuses, posting a YouTube video that describes the benefits of volunteering for research, starting a program in which community health organizations exchange URL links, partnering with national organizations to promote national health awareness days, and sponsoring community fun runs. For a nominal fee of $50, one CTSA institution negotiated the placement of the ResearchMatch logo on t-shirts for a local race. ResearchMatch also makes daily updates to its Facebook and Twitter accounts, “liking” (Facebook) and “following” (Twitter) all CTSA institutions and other health-related organizations such as Special Olympics, the American Cancer Society, and St. Jude Children's Research Hospital. The daily postings focus on providing health education, recognizing national health awareness days, and finding opportunities to participate in research. These social marketing methods are already paying off in terms of increasing awareness and recruitment in underrepresented areas.
Volunteer health information
We devoted significant time to ensuring that the registration process enables volunteers to accurately and conveniently enter their known medical conditions and medication usage. Volunteers type in their conditions and ResearchMatch automatically searches for and suggests standardized terms found in the UMLS metathesaurus. ResearchMatch maps all free-form entries to coded terminology mapping procedural operations. When we first launched ResearchMatch, we found that approximately 10% of registrants had problems finding standardized matches for their conditions or medications. Because the majority of these problems came from spelling mistakes, we added an auto-completer function to assist during data entry; this has reduced reported problems to less than 5%.
Approximately half (45.5%) of ResearchMatch volunteers reported having no medical or health conditions, and a similar number report taking no medications. The participation of this subgroup of motivated, healthy volunteers, who can be recruited as healthy participants or control subjects for studies, is likely due to ResearchMatch's disease-neutral promotion (e.g., “everyone can join”), in contrast to other registries that focus on a particular disease or condition. The medical conditions and medications reported by the remaining volunteers seem representative of those of the overall population. The top five medical conditions reported by ResearchMatch volunteers are hypertension, depression, asthma, anxiety, and migraine headache. The most commonly listed medications are Synthroid, vitamin D, aspirin, Lisinopril, and Zyrtec.
Researcher activity and study matching
ResearchMatch has proven itself an effective tool for matching volunteers with researchers conducting clinical and translational research. The enrollment data in Tables 2 and 3 most likely represent a very conservative estimate given that we ask but do not require researchers to let us know when ResearchMatch volunteers are enrolled. More and more researchers are using the tracking tools we provide, and, if necessary, we may add stronger incentives for reporting the status of volunteers. Table 2 shows that a high percentage (74%) of known enrolled study participants are enrolled in behavioral studies, but nearly 500 volunteers are known to have enrolled in other types of studies.
Approximately 20% of the volunteers contacted with specific study messages indicated that they were interested in the study (Figure 2). Within the ResearchMatch network, we are considering “research on research” examinations of outlier studies that have much higher or lower response rates than the measured “normal” rate. By studying these overachieving and underachieving studies, we hope to characterize useful best practices for searching and contacting volunteers.
Sustainability and potential for future growth
The CTSA program was designed to support diverse scientific research and to leverage the collective power of 60 top-tier research institutions. We are indebted to all the institutions of the CTSA consortium, which has been essential in building both the technical workflow and regulatory permissions model for ResearchMatch. The cost of maintaining ResearchMatch is small in comparison to the value derived across the network, and we anticipate continuing to support and grow the program indefinitely.
Although the CTSA consortium is substantial, it serves only a subset of research teams conducting research in the U.S. today. We are also currently exploring ways to expand ResearchMatch network access to academic institutions beyond the CTSA consortium.
ResearchMatch has proven successful as a national, disease-neutral, institution-neutral, Web-based tool for recruiting study participants. The project has built collaborative bridges between 61 academic research institutions and helped recruit participants for many studies. Volunteers have reacted positively to the secure, self-service model that allows them to actively manage their health histories, and research teams have found the tool's model for permissions and self-service search and contact effective. As we continue to invest in the program, we look forward to improving and growing it to meet the ever-evolving needs of the volunteer and researcher communities.
The authors wish to thank Dr. Gordon Bernard, Mr. Mate' Sztipanovitz, all institutional liaisons at participating institutions, and the volunteers and researchers using ResearchMatch.
Supported in part by Vanderbilt CTSA grant 1 UL1 RR024975 from the National Center for Research Resources, National Institutes of Health.
ResearchMatch has active approval from the Vanderbilt IRB as a recruitment tool.
1Walson PD. Patient recruitment: U.S. perspective. Pediatrics. 1999;104(3 pt 2):619–622.
2Gul RB, Ali PA. Clinical trials: The challenge of recruitment and retention of participants. J Clin Nurs. 2010;19:227–233.
4Getz K. The Gift of Participation: A Guide to Making Informed Decisions About Volunteering for a Clinical Trial. Bar Harbor, Me: Jerian Publishing; 2007.
5Pew Internet and American Life Project. The Shared Search for Health Information on the Internet. Washington, DC: Pew Research Center; 2009.
7Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in clinicaltrials.gov: A cross-sectional analysis. PLoS Med. September 2009;6:e1000144.
8Lara PN Jr, Paterniti DA, Chiechi C, et al. Evaluation of factors affecting awareness of and willingness to participate in cancer clinical trials. J Clin Oncol. 2005;23:9282–9289.
9Atkinson NL, Saperstein SL, Massett HA, Leonard CR, Grama L, Manrow R. Using the Internet to search for cancer clinical trials: A comparative audit of clinical trial search tools. Contemp Clin Trials. 2008;29:555–564.
15Harris PA, Lane L, Biaggioni I. Clinical research subject recruitment: The Volunteer for Vanderbilt Research Program. J Am Med Inform Assoc. 2005;12:608–613.
25Paskett ED, Reeves KW, McLaughlin JM, et al. Recruitment of minority and underserved populations in the United States: The Centers for Population Health and Health Disparities experience. Contemp Clin Trials. 2008;29:847–861.
26Ford JG, Howerton MW, Lai GY, et al. Barriers to recruiting underrepresented populations to cancer clinical trials: A systematic review. Cancer. 2008;112:228–242.
27Cantrell MA, Lupinacci P. Methodological issues in online data collection. J Adv Nurs. 2007;60:544–549.
28Rhodes SD, Bowie DA, Hergenrather KC. Collecting behavioural data using the world wide web: Considerations for researchers. J Epidemiol Community Health. 2003;57:68–73.