Reliability of Reporting on Life-Style and Agricultural Factors by a Sample of Participants in the Agricultural Health Study from Iowa
Blair, Aaron1; Tarone, Robert1; Sandler, Dale2; Lynch, Charles F.3; Rowland, Andrew2; Wintersteen, Wendy4; Steen, William C.5; Samanic, Claudine1; Dosemeci, Mustafa1 and; Alavanja, Michael C. R.1
From the 1Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, MD;
2Epidemiology Branch, National Institute of Environmental Health Sciences, Research Triangle Park, NC;
3Department of Epidemiology, University of Iowa, Iowa City, IA;
4Iowa State University Extension Service, Ames, IA; and
5U.S. Environmental Protection Agency, Athens, GA.
Address correspondence to: Aaron Blair, Division of Cancer Epidemiology and Genetics, National Cancer Institute, EPS Room 8118, Bethesda, MD 20892; firstname.lastname@example.org
This work was supported by intramural funds from the National Cancer Institute.
Submitted May 8, 2001; final version accepted September 16, 2001.
Repeat interviews from 4,088 Iowa pesticide applicators participating in the Agricultural Health Study provided the opportunity to evaluate the reliability of self-reported information on pesticide use and various demographic and life-style factors. Self-completed questionnaires were administered 1 year apart when participants returned to county agricultural extension offices for pesticide certification or training. Percentage agreement for ever-/never-use of specific pesticides and application practices was quite high, generally ranging from 70% to more than 90%, and did not vary by age, educational level, or farm size. Agreement was lower (typically 50–60%) for duration, frequency, or decade of first use of specific pesticides. Level of agreement regarding pesticide use in this population is similar to that generally found for factors typically used in epidemiologic studies such as tobacco use and higher than typically reported for diet, physical activity, and medical conditions.
The Agricultural Health Study is a long-term prospective cohort study designed to evaluate cancer and other diseases among farmers and their families in relation to agricultural exposures and life-style factors. 1 Farmers in Iowa and North Carolina, as well as commercial applicators in Iowa, were asked to participate in the study when they sought pesticide licenses or training at county agricultural extension offices. Self-completed questionnaires were used to obtain information on agricultural exposures and other factors necessary to evaluate disease risks.
Although questionnaires have long been used by the Economic Research Service of the U.S. Department of Agriculture (USDA) to obtain information on agricultural practices from farmers, 2,3 and farmers can provide considerable detail about their pesticide practices, 4,5 few studies have evaluated the reliability of information obtained on agricultural practices in epidemiologic investigations. 6 We took advantage of a special situation in Iowa to assess the reporting consistency for agricultural and life-style factors on a sample of the cohort that completed two questionnaires approximately 1 year apart.
Subjects and Methods
Participants in the Agricultural Health Study enrolled by completing a self-administered questionnaire when they came to the county agricultural extension offices to seek pesticide certification and training. At the beginning of the study, applicators in Iowa were required to take an examination in which a passing mark gained them certification for 3 years. Enrollment and completion of the questionnaires occurred from 1994 through 1996. After initiation of the study, the Iowa legislature changed procedures regarding pesticide certification for private applicators by allowing annual training as an alternative to the examination. This change meant that some individuals who chose pesticide training and completed the enrollment questionnaire one year would return for training the following year, which provided us the opportunity to compare information from questionnaires completed 1 year apart. Individuals returning for training who had already enrolled in the Agricultural Health Study were given a questionnaire containing a subset of the questions originally asked on selected pesticide practices and life-style factors.
The abbreviated questionnaire was administered at the county agricultural extension office in the same fashion as the original enrollment version. 1 It was completed by 2,895 applicators (2,842 men and 53 women). In addition, a second group of 1,193 applicators who completed the enrollment questionnaire and returned for training the following year inadvertently completed the full enrollment questionnaire a second time. An analysis of the separate and combined data revealed that these two groups were similar with respect to age, gender, marital status, education, and other factors (data not shown). We combined these two groups for analysis, which resulted in 4,088 respondents (4,008 men and 80 women). Most of these were private applicators (3,829), but 259 were commercial applicators. We compared responses on the first and second questionnaires by calculating percentage exact agreement, percentage agreement within one category (for quantitative or ordinal categories), and kappa statistic. 7 We calculated weighted kappas for multiple-response questions such as years or days per year of pesticide application.
The reliability subgroup was very similar to the full cohort for various factors including age, gender, marital status, and farm size (data not shown).
Comparability of reported use of pesticides and method of application is shown in Table 1. Although agreement on ever mixed or applied any pesticide was high (95%), kappa was considerably lower (0.15) because the proportion of subjects who had never used pesticides was very small. The reliability of reported use for specific chemicals was high and quite consistent (from 79% for carbaryl to 88% for permethrin) with no apparent differences by pest class, chemical class, or prevalence of use. Kappas ranged from 0.48 to 0.71. For the method of pesticide application, agreement of responses from the two questionnaires ranged from 72% to 99%. The range of values for kappa was from 0.11 to 0.56.
We evaluated the number of paired responses falling above and below the diagonal of exact agreement, ie, individuals providing different responses on the two questionnaires. For ever mixed or applied specific pesticides, the numbers were typically equally distributed above and below the diagonal of agreement, with the possible exception of malathion, carbaryl, and dichlorodiphenyltrichloroethane, for which considerably more positive responses were found in the original than in the second questionnaire (either follow-up abbreviated questionnaire or duplicated enrollment questionnaire).
The numbers of pairs falling above and below the diagonal were also similar for method of pesticide application. Sign tests of distributions were not statistically significant for ever-use of pesticides or method of application. Thus, there was no obvious tendency to get “yes” or “no” responses from one or the other of the questionnaires.
For years and days per year of mixing or applying any pesticides, exact agreement percentages were 55% and 45%, respectively, and weighted kappas were 0.56 and 0.45, respectively (Table 2). For each factor, 89% and 90% of the subjects were within one category of agreement.
Exact agreement for estimated percentage of the time subjects mixed or applied pesticides was 72% and 79%, respectively, with kappas of 0.39 and 0.47 (Table 2). Agreement within one category of exact agreement was 98% and 99%. In addition, exact agreement for years, days per year, and decade of use of specific pesticides was generally in the 50–70% range, which was lower than for dichotomous outcomes such as ever-/never-use (Table 1). Ninety per cent of the subjects gave responses within one category of agreement on the two questionnaires. Kappas were between 0.37 and 0.63.
Responses regarding frequency of reported symptoms after using pesticides were similar in the two questionnaires, as shown in Table 3. Exact agreement ranged from 76% to 92% with kappas from 0.31 to 0.45. Agreement within one response category was nearly 100%.
We evaluated level agreement by age, education, and farm size. For ever-handled any pesticide, the level of exact agreement was 94% or higher, with kappas ranging from 0.10 to 0.18. Exact agreement for ever-handled specific pesticides was between 80% and 90%, with kappas ranging from 0.42 to 0.73 (Table 4). Level of agreement for methods of application did not differ by age, amount of education, or farm size (data not shown).
We also compared responses for tobacco use and reported disease histories. Agreement was very high (over 90%) for smoking cigarettes and quite high for number of cigarettes per day (76%). Kappas were also high (0.71 for number of cigarettes per day and 0.87 for ever-smoked cigarettes). Percentage agreement for diseases the subject reported for themselves and their relatives was more than 90%. Kappas were more variable with values of 0.71 for asthma, 0.65 for pneumonia, 0.34 for kidney disease, and 0.10 for Parkinson’s disease. The kappa for Parkinson’s disease was low, despite high ex-act agreement, because there were a relatively small number of persons reporting this disease. Kappas for cancers among relatives were 0.64 for lung, 0.70 for breast, and 0.41 for the lymphatic and hematopoietic system.
Percentage agreement and kappas calculated for agricultural and life-style factors for commercial applicators separately were essentially identical to those of private applicators (data not shown).
About one-third of the study group completed the full enrollment questionnaire twice (N = 1,193). We used these data to compare reliability of responses to questions not included in the abbreviated follow-up questionnaire, including alcohol drinks per day (71% exact agreement; kappa = 0.63), vegetable servings per day (35% exact agreement; kappa = 0.43), and fruit servings per day (40% exact agreement; kappa = 0.49).
The USDA has used questionnaires to assemble information on pesticide use by farmers for many years. 2,3 Use of interviews to obtain information on pesticide use and exposure in epidemiologic research is a more recent phenomenon. 4 There are differences between the approach used by the USDA and the approach required for epidemiologic research. The USDA typically obtains information on the past year. The long latency associated with most chronic disease, however, requires that epidemiologic studies obtain data on pesticide use from several years in the past, underscoring the need to evaluate the reliability and validity of information on pesticides obtained by interview. 8
In the present analyses, the time frame for questions on pesticide use and other factors covered the subject’s entire farming history of use up to the interview, so for many this required quite lengthy recall. Several general patterns were observed. First, agreement for self-reported smoking, selected diseases, and other factors in this population was consistent with other reports in the literature, ie, in the 90% range. 9–11,14,19–21 Second, the reported agreement for ever-/never-use of specific pesticides is also quite high, ie, mostly in the 70–90% range; these compare favorably with the reliability reported in other studies for factors such as smoking and alcohol use and are better than those reported for diet, physical activity, and health conditions. Third, the level of agreement on pesticide reporting decreased as the amount of detail sought increased, such as the number of years a person applied specific pesticides instead of ever-/never-use. This is similar to other factors such as tobacco use, in which agreement for the number of cigarettes smoked per day is lower than reporting of ever having smoked. Fourth, for pesticide factors, as well as for life-style factors and disease, the disagreements between the enrollment and follow-up interviews were symmetrical, ie, there was no general tendency for a higher prevalence of positive reporting in one or the other questionnaire administration. For example, in situations in which subjects reported at one interview that they used a particular pesticide but not at the other, the number of positive reports was about equivalent for the enrollment and follow-up interviews. This suggests that the additional year of farming experience before the completion of the follow-up questionnaire had little impact on the amount of disagreement. If dramatic changes occurred in the farming operation from one year to the next, we might have expected a disproportionate number of positive or negative responses to specific responses on the follow-up questionnaire. Still, some of the disagreements could be due to changes in pesticide application activities by study participants between the first and second questionnaires. Fifth, for questions with quantitative or ordinal responses, percentage agreement within one response category was quite high, typically 80% or higher. This is especially important for epidemiologic studies because responses are often grouped into a few categories. Sixth, percentage agreement did not differ by age, level of education, or farm size, which suggests a relatively consistent reliability of reporting among the various subgroups of the cohort. Finally, it is interesting that the values for number of cigarettes per day, years of pesticide use, and days per year of pesticide use from the abbreviated questionnaire were virtually identical to those on the original enrollment questionnaire, which indicates that these reliability results are applicable to the entire cohort.
The kappas for interview-reinterview for pesticides generally ranged from 0.20 to 0.50. Although perfect agreement would generate a value of 1.0, values much lower can represent good agreement. This is because kappas are highly dependent on prevalence of the characteristic in the population, as well as on the sensitivity and specificity of the measure. 12 Thompson and Walter 12 have shown that for factors with a true prevalence of 0.2 to 0.8 and sensitivities and specificities that are quite high (in the 70–90% range), kappas fall into a range 0.3–0.6. Most values we observed are in this range. The few exceptions of kappas outside this range are for reporting on rare diseases or activities performed by nearly all applicators. Kappas can be quite low, and level of exact agreement is high for situations in which the factor is very prevalent or extremely rare. This was the situation when we observed low kappas.
The dependence of kappa on response prevalence is most obvious for questions with dichotomous response options to which few subjects gave a particular response (eg, “Did you pour fumigants?” or “Have you been diagnosed with Parkinson’s disease?”) or questions to which almost all subjects gave a particular response (eg, “Have you ever personally handled pesticides?”). In such situations the percentage exact agreement will always be near 100% (ie, almost all subjects give the majority response on both questionnaires), but kappas may be quite low (eg, if the few minority responses tend to come from different subjects for the second questionnaire than for the first questionnaire).
Few reports are available on the reliability of reported pesticide use specifically among farmers. Van Der Gulden et al13 found 82% agreement and kappas of 0.55 for reported occupational exposure to pesticides from a reliability study in the Netherlands. Farrow et al14 found kappas of about 0.29 for weed killers and 0.53 for pesticides/insecticides in general for women completing self-reported questionnaires before and after a miscarriage. These are somewhat lower than we found for specific pesticides (range of 0.48–0.70), but this might be expected because women in the miscarriage study were not from farms where pesticide use had a very important economic component, which might facilitate recall.
Several reports have compared reported pesticide use among farmers and surrogates, 4,5,15–18 and these provide a framework for considering results in this study. Agreement between farmers and pesticide suppliers regarding farmers’ use of pesticides was about 50–60%. 4 Agreement between farmers and surrogates (primarily wives) on reported use of specific pesticides was about 50–70%. 5,17 A comparison of self-assessed and expert-assessed exposure to pesticides and fertilizers found an agreement of 91% with a kappa of 0.53 in a case-control study from Montreal. 18 The level of agreement we observed from repeat interviews is generally better than that from comparisons between subjects and surrogates.
Although the reliability of reported pesticide use among Iowa farmers is as good as for many other factors assessed by questionnaires in epidemiologic research and better than for some variables, 9–11,14,19–21 it is important to assess effects of potential misclassification on estimates of relative risk. If the level of agreement between the first and second interviews is considered a measure of nondifferential exposure misclassification, we can calculate effects on relative risks. 22 For example, if the true relative risk was 4.0 and nondifferential misclassification for ever-/never-handled individual pesticides is as in Table 1 (from 79% to 88% agreement), the calculated relative risks would range from 2.0 to 2.6. If the true relative risk was 2.0, calculated relative risks for individuals pesticides would be from 1.1 to 1.6. Even though the level of agreement is quite high, the impact of misclassification in this range on the relative risks can be substantial and diminish the opportunity to detect real associations. It is important to note that nondifferential misclassification, ie, misclassification that does not differ by presence or absence of disease, would only diminish estimates of relative risk for dichotomous classifications in a prospective investigation such as the Agricultural Health Study. It could, however, result in an increase or decrease in calculated relative risks in multiple response situations for the middle exposure categories, but not for the upper exposure category. In the upper exposure category, nondifferential misclassification would always diminish the relative risk. 23 Although these data suggest that pesticide use is reliably reported by farmers in this cohort, it is important to underscore that they do not provide information on the validity of these reports.
In summary, agreement for self-reported use of pesticides by farmers is similar to that found for other factors routinely evaluated by questionnaire in epidemiology studies such as smoking and alcohol reporting, and better than others such as consumption of fruits and vegetables and physical activity. Because epidemiologic studies have successfully related disease risk to these factors, it seems likely that information on pesticide use from interviews can also be used successfully to address exposure-disease relationships.
1. Alavanja MCR, Sandler DP, McMaster SB, et al. The Agricultural Health Study. Environ Perspect 1996; 104: 362–369.
2. Blake HT, Andrilenas PA, Jenkins RP, Eichers TR, Fox AS. Farmers’ Pesticide Expenditures in 1966. Agricultural Economic Report No. 192. Washington DC: Economic Research Service, 1970.
3. Blake HT, Andrilenas PA. Farmers’ Use of Pesticides in 1971. Agricultural Economic Report No. 296. Washington DC: Economic Research Service, U.S. Department of Agriculture, 1975.
4. Blair A, Zahm SH. Patterns of pesticide use among farmers: implications for epidemiologic research. Epidemiology 1993; 4: 55–62.
5. Blair A, Stewart PA, Kross B, et al. Comparison of two techniques to obtain information on pesticide use from Iowa farmers by interview. J Agric Safety Health 1997; 3: 229–236.
6. Blair A, Zahm SH. Methodologic issues in exposure assessment for case-control studies of cancer and herbicides. Am J Ind Med 1990; 18: 285–293.
7. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 1968; 70: 213–220.
8. Blair A, Zahm SH, Cantor KP, Stewart PA. Estimating exposure to pesticides in epidemiological studies of cancer. In: Wang RGM, Franklin CA, Honeycutt RC, Reinert JC, eds. Biologic Monitoring for Pesticide Exposure. ACS Symposium Series, No. 382. Washington DC: American Chemical Society, 1989: 38–46.
9. Persson P-G, Norell SE. Retrospective vs original information on cigarette smoking. Am J Epidemiol 1989; 130: 705–712.
10. Kelly JP, Rosenberg L, Kaufman DW, Shapiro S. Reliability of personal interview data in a hospital-based case-control study. Am J Epidemiol 1990; 131: 79–90.
11. Jain M, Howe GR, Rohan T. Dietary assessment in epidemiology: comparison of a food frequency and diet history questionnaire with a 7-day food record. Am J Epidemiol 1996; 143: 953–960.
12. Thompson WD, Walter SD. A reappraisal of the kappa coefficient. J Clin Epidemiol 1998; 41: 949–958.
13. Van Der Gulden JWJ, Jansen IW, Verbeek ALM, Kolk JJ. Repeatability of self-reported data on occupational exposure to particular compounds. Int J Epidemiol 1993; 22: 284–287.
14. Farrow A, Farrow SC, Little R, Golding J, ALSPAC Study Team. The repeatability of self-reported exposure after miscarriage. Int J Epidemiol 1996; 25: 797–806.
15. Brown LM, Dosemeci M, Blair A, Burmeister L. Comparability of data obtained from farmers and surrogate respondents on use of agricultural pesticides. Am J Epidemiol 1991; 134: 348–355.
16. Boyle CA, Brann EA, and the Selected Cancers Cooperative Study Group. Proxy respondents and the validity of occupational and other exposure data. Am J Epidemiol 1992; 136: 712–721.
17. Johnson RA, Mandel JS, Gibson RW, et al. Data on prior pesticide use collected for self and proxy respondents. Epidemiology 1993; 4: 157–164.
18. Fritschi L, Siemiatycki J, Richardson L. Self-assessed vs expert-assessed occupational exposures. Am J Epidemiol 1996; 144: 521–527.
19. Herrmann N. Retrospective information from questionnaires. II. Intrarater reliability and comparison of questionnaire types. Am J Epidemiol 1985; 121: 948–953.
20. Blair SN, Dowda M, Pate RR, et al. Reliability of long-term recall of participation in physical activity by middle-aged men and women. Am J Epidemiol 1991; 133: 266–275.
21. Hahn RA, Truman BI, Barker ND. Identifying ancestry: the reliability of ancestral identification in the United States by self, proxy, interviewer, and funeral director. Epidemiology 1996; 7: 75–80.
22. Copeland KT, Checkoway H, McMichael AJ, Holbrook RH. Bias due to misclassification in the estimation of relative risk. Am J Epidemiol 1977; 105: 488–495.
23. Dosemeci M, Wacholder S, Lubin JH. Does nondifferential misclassification of exposure always bias a true effect toward the null value? Am J Epidemiol 1990; 132: 746–748.
This article has been cited 76 time(s).
Cancer Epidemiology Biomarkers & PreventionPesticide Exposure and Inherited Variants in Vitamin D Pathway Genes in Relation to Prostate CancerCancer Epidemiology Biomarkers & Prevention
American Journal of EpidemiologyRisk of Total and Aggressive Prostate Cancer and Pesticide Use in the Agricultural Health StudyAmerican Journal of Epidemiology
Plos OneGenetic Susceptibility Loci, Pesticide Exposure and Prostate Cancer RiskPlos One
International Journal of CancerMultiple pesticide exposures and the risk of multiple myeloma in Canadian menInternational Journal of Cancer
International Archives of Occupational and Environmental HealthPesticide use and fatal injury among farmers in the Agricultural Health StudyInternational Archives of Occupational and Environmental Health
Environmental Health PerspectivesLifetime Pesticide Use and Telomere Shortening among Male Pesticide Applicators in the Agricultural Health StudyEnvironmental Health Perspectives
Journal of Immigrant and Minority HealthSelf-Reported Prior Lung Diseases as Risk Factors for Non-small Cell Lung Cancer in Mexican AmericansJournal of Immigrant and Minority Health
Cancer Epidemiology Biomarkers & PreventionUse of the Cytokinesis-Blocked Micronucleus Assay to Detect Gender Differences and Genetic Instability in a Lung Cancer Case-Control StudyCancer Epidemiology Biomarkers & Prevention
American Journal of Respiratory and Critical Care MedicineDiesel exhaust, solvents, and other occupational exposures as risk factors for wheeze among farmersAmerican Journal of Respiratory and Critical Care Medicine
American Journal of EpidemiologyRetinal degeneration and other eye disorders in wives of farmer pesticide applicators enrolled in the agricultural health studyAmerican Journal of Epidemiology
Toxicological SciencesCan exposure characterization explain concurrence of discordance between toxicology and epidemiology?Toxicological Sciences
American Journal of Industrial MedicinePesticide use and chronic bronchitis among farmers in the agricultural health studyAmerican Journal of Industrial Medicine
Environmental ResearchChlorothalonil exposure and cancer incidence among pesticide applicator participants in the agricultural health studyEnvironmental Research
American Journal of EpidemiologyPesticide use and breast cancer risk among farmers' wives in the agricultural health studyAmerican Journal of Epidemiology
Parkinsonism & Related DisordersTest-retest repeatability of self-reported environmental exposures in Parkinson's disease cases and healthy controlsParkinsonism & Related Disorders
American Journal of EpidemiologyPesticide exposure and self-reported Parkinson's disease in the agricultural health studyAmerican Journal of Epidemiology
Occupational and Environmental MedicinePesticides and other agricultural factors associated with self-reported farmer's lung among farm residents in the Agricultural Health StudyOccupational and Environmental Medicine
Chemistry & Industry
Small thinking about big data
Chemistry & Industry, (8):
American Journal of EpidemiologyCancer incidence among pesticide applicators exposed to alachlor in the Agricultural Health StudyAmerican Journal of Epidemiology
International Journal of CancerCancer incidence among pesticide applicators exposed to metolachlor in the Agricultural Health StudyInternational Journal of Cancer
Occupational and Environmental MedicineRhinitis associated with pesticide exposure among commercial pesticide applicators in the Agricultural Health StudyOccupational and Environmental Medicine
Journal of Exposure Analysis and Environmental EpidemiologyAccuracy of self-reported pesticide use duration information from licensed pesticide applicators in the Agricultural Health StudyJournal of Exposure Analysis and Environmental Epidemiology
International Journal of CancerOccupational exposure to organochlorine insecticides and cancer incidence in the Agricultural Health StudyInternational Journal of Cancer
BloodPesticide exposure and risk of monoclonal gammopathy of undetermined significance in the Agricultural Health StudyBlood
NeurologyOccupational exposure to pesticides increases the risk of incident AD The Cache County StudyNeurology
International Journal of CancerNon-Hodgkin's lymphoma among asthmatics exposed to pesticidesInternational Journal of Cancer
Environmental Health PerspectivesS-Ethyl-N,N-dipropylthiocarbamate Exposure and Cancer Incidence among Male Pesticide Applicators in the Agricultural Health Study: A Prospective CohortEnvironmental Health Perspectives
International Journal of Occupational and Environmental Health
Cancer Incidence Among Paraquat Exposed Applicators in the Agricultural Health Study Prospective Cohort Study
International Journal of Occupational and Environmental Health, 15(3):
American Journal of EpidemiologyPesticides and Myocardial Infarction Incidence and Mortality Among Male Pesticide Applicators in the Agricultural Health StudyAmerican Journal of Epidemiology
Environmental Health PerspectivesOccupational exposure to carbofuran and the incidence of cancer in the Agricultural Health StudyEnvironmental Health Perspectives
Environmental Health Perspectives
Cancer risk and parental pesticide application in children of agricultural health study participants
Environmental Health Perspectives, 112(5):
Annual Review of Public HealthHealth effects of chronic pesticide exposure: Cancer and neurotoxicityAnnual Review of Public Health
Environmental Health PerspectivesNeurologic symptoms in licensed private pesticide applicators in the Agricultural Health StudyEnvironmental Health Perspectives
Scandinavian Journal of Work Environment & Health
Biomonitoring of herbicides in Ontario farm applicators
Scandinavian Journal of Work Environment & Health, 31():
Environmental Health PerspectivesCancer incidence among pesticide applicators exposed to dicamba in the Agricultural Health StudyEnvironmental Health Perspectives
Journal of Occupational and Environmental HygieneThe validation of a pesticide exposure algorithm using biological monitoring resultsJournal of Occupational and Environmental Hygiene
Environmental Health PerspectivesCancer Incidence among Pesticide Applicators Exposed to Permethrin in the Agricultural Health StudyEnvironmental Health Perspectives
Cancer Causes & ControlOccupational exposure to terbufos and the incidence of cancer in the Agricultural Health StudyCancer Causes & Control
Journal of Exposure Science and Environmental EpidemiologyExposure profiles of pesticides among greenhouse workers: implications for epidemiological studiesJournal of Exposure Science and Environmental Epidemiology
American Journal of EpidemiologyMalathion exposure and the incidence of cancer in the agricultural health studyAmerican Journal of Epidemiology
International Journal of CancerAgricultural pesticide use and pancreatic cancer risk in the Agricultural Health Study CohortInternational Journal of Cancer
Environmental Health PerspectivesPesticide Exposure and Hypertensive Disorders during PregnancyEnvironmental Health Perspectives
American Journal of EpidemiologyUse of agricultural pesticides and prostate cancer risk in the agricultural health study cohortAmerican Journal of Epidemiology
Diabetes CarePesticide exposure and self-reported gestational diabetes mellitus in the agricultural health studyDiabetes Care
International Journal of CancerPesticide use and colorectal cancer risk in the Agricultural Health StudyInternational Journal of Cancer
Environmental Health PerspectivesCoumaphos Exposure and Incident Cancer among Male Participants in the Agricultural Health Study (AHS)Environmental Health Perspectives
International Journal of CancerProstate cancer and exposure to pesticides in agricultural settingsInternational Journal of Cancer
Environmental Health Perspectives
Cancer incidence among glyphosate-exposed pesticide applicators in the agricultural health study
Environmental Health Perspectives, 113(1):
Scandinavian Journal of Work Environment & Health
Integrating exposure measurements into epidemiologic studies in agriculture
Scandinavian Journal of Work Environment & Health, 31():
Environmental Health PerspectivesBiomonitoring of 2,4-dichlorophenoxyacetic acid exposure and dose in farm familiesEnvironmental Health Perspectives
Journal of the National Cancer InstituteCancer incidence among pesticide applicators exposed to chlorpyrifos in the agricultural health studyJournal of the National Cancer Institute
Movement DisordersTest-retest repeatability of assessing environmental and lifestyle factors in Parkinson's diseaseMovement Disorders
International Journal of CancerHeterocyclic aromatic amine pesticide use and human cancer risk: Results from the US Agricultural Health StudyInternational Journal of Cancer
Environmental ResearchCancer incidence among pesticide applicators exposed to butylate in the Agricultural Health Study (AHS)Environmental Research
International Journal of Occupational and Environmental Health
An icon-based interview for the assessment of occupational pesticide exposure in a case-control study of childhood leukemia
International Journal of Occupational and Environmental Health, 10(1):
Environmental Health PerspectivesCancer incidence among pesticide applicators exposed to cyanazine in the agricultural health studyEnvironmental Health Perspectives
Annals of Occupational HygieneExposure misclassification of household pesticides and risk perception and behaviourAnnals of Occupational Hygiene
American Journal of EpidemiologyPesticides associated with wheeze among commercial pesticide applicators in the Agricultural Health StudyAmerican Journal of Epidemiology
American Journal of EpidemiologyIncident diabetes and pesticide exposure among licensed pesticide applicators: Agricultural Health Study, 1993-2003American Journal of Epidemiology
Cancer Causes & ControlCancer incidence among pesticide applicators exposed to captan in the Agricultural Health StudyCancer Causes & Control
Environmental Health PerspectivesDepression and Pesticide Exposures among Private Pesticide Applicators Enrolled in the Agricultural Health StudyEnvironmental Health Perspectives
American Journal of EpidemiologyPesticides and lung cancer risk in the agricultural health study cohortAmerican Journal of Epidemiology
Annals of EpidemiologyMortality among participants in the agricultural health studyAnnals of Epidemiology
Human & Experimental ToxicologyNeurologic symptoms in licensed pesticide applicators in the Agricultural Health StudyHuman & Experimental Toxicology
International Journal of CancerCarbaryl exposure and incident cancer in the Agricultural Health StudyInternational Journal of Cancer
Environmental ResearchCancer incidence among pesticide applicators exposed to trifluralin in the Agricultural Health StudyEnvironmental Research
Marketing LettersThe effect of synchronizing consumers' diurnal preferences with time of response on data reliabilityMarketing Letters
Journal of Exposure Analysis and Environmental EpidemiologySeed treatment and its implication for fungicide exposure assessmentJournal of Exposure Analysis and Environmental Epidemiology
European Journal of Cancer PreventionReliability of self-reported household pesticide useEuropean Journal of Cancer Prevention
Journal of Occupational and Environmental MedicineHearing Loss Among Licensed Pesticide Applicators in the Agricultural Health StudyJournal of Occupational and Environmental Medicine
Journal of Occupational and Environmental MedicinePatterns of Pesticide Use and Their Determinants Among Wives of Farmer Pesticide Applicators in the Agricultural Health StudyJournal of Occupational and Environmental Medicine
Journal of Occupational and Environmental MedicineChronic Bronchitis Among Nonsmoking Farm Women in the Agricultural Health StudyJournal of Occupational and Environmental Medicine
Journal of Occupational and Environmental MedicinePesticide Use and Myocardial Infarction Incidence Among Farm Women in the Agricultural Health StudyJournal of Occupational and Environmental Medicine
Cancer Causes & ControlDichlorvos exposure and human cancer risk: results from the Agricultural Health StudyCancer Causes & Control
Environmental Health PerspectivesMortality among pesticide applicators exposed to chlorpyrifos in the agricultural health studyEnvironmental Health Perspectives
pesticides; reliability; agriculture
© 2002 Lippincott Williams & Wilkins, Inc.
Highlight selected keywords in the article text.