*Universitat Rovira i Virgili, IISPV, Reus, Spain
†Hauner Children's Hospital, University of Munich Medical Centre, Munich, Germany
‡Department of Pediatrics, University of Milan, San Paolo Hospital, Milan, Italy
§Children's Memorial Health Institute, Warsaw, Poland
||CHC St Vincent Liège, Belgium.
Address correspondence and reprint requests to Ricardo Closa-Monasterolo, Paediatrics Unit, Universitat Rovira i Virgili, IISPV, C/Sant Llorenç 21, 43201 Reus, Spain (e-mail: email@example.com).
Received 5 July, 2012
Accepted 23 September, 2012
www.clinicaltrials.gov registration number: NCT00338689.
European Childhood Obesity Project Study Group members: Grote V, Koletzko B, Beyer J, Demmelmair H, Fritsch M, Haile G, Handel U, Hannibal I, Pawellek I, Schiess S, Verwied-Jorky S, von Kries R, Weber M (Children's University Hospital, University of Munich Medical Centre, Munich, Germany), Escribano J, Closa R, Luque V, Ferre N, Zaragoza-Jordana M, Mendez-Riera G (Pediatrics Unit, Universitat Rovira i Virgili, IISPV, Reus, Spain), Gruszfeld D, Socha P, Socha J, Dobrzańska A, Janas R, Wierzbicka A (Children's Memorial Health Institute, Warsaw, Poland), Carlier C, Dain E, Goyens P, Hoyos J, Poncelet P (ULB, Bruxelles, Belgium), Xhonneux A, Van Hees JN, Langhendries J-P (CHC St Vincent Liege, Belgium), Perrin E (Danone Research Centre for Specialized Nutrition, Schiphol, The Netherlands), Agostoni C, Giovannini M, Re Dionigi A, Riva E, Scaglioni S, Vecchi F, Verducci E (University of Milan).
The European Childhood Obesity Project was carried out with the financial support of the European Community, under the 5th Framework Programme for Research, Technology & Demonstration “Quality of Life and Management of Living Resources,” Key Action 1 (Food, Nutrition & Health), contract number QLK1-CT2002-389. B.K. is the recipient of a Freedom to Discover Award from the Bristol-Myers Squibb Foundation, New York, NY. This article does not necessarily reflect the views of the Commission and in no way anticipates its future policy in this area.
The authors report no conflicts of interest.
The estimation of dietary intake remains a challenge in human nutritional studies. Methods available to collect information about dietary intake are imprecise (1,2). Nutritionists need to develop specific systems and standard operating procedures (SOPs) to ensure the maximum accuracy and quality of data, taking into account factors such as the target population and the aim of the evaluation (3). Typical sources of error when researchers and clinicians try to assess dietary intake are participants’ misreporting, incomplete information in food diaries (FDs), errors in interpretation and calculations transferring the reported data to the database, and difficulties in finding appropriate nutrient composition databases (1). In children, additional sources of error can influence the accuracy of dietary intake assessments. These sources of error depend particularly on the child's age (including their ability to estimate portions, their capacity to recall food intake, the use parents as proxy reporters) (1,4). Training participants in reporting dietary intake as well as training nutritionists in revising the reported information (extracting as many details as possible) are essential for obtaining accurate data.
These rules were taken into account within the European Childhood Obesity Project, a large multicentre randomised clinical trial to examine the effects of protein intake during the first months of life on later obesity risk (5). In 5 countries (Germany, Belgium, Italy, Poland, and Spain), 1138 formula-fed healthy infants were recruited and randomised into 2 arms receiving powdered study formulas with lower or higher protein content, according to the European Commission Directive (6). The dietary intake of participating infants was recorded by parents, who completed ten 3-day FDs during the first year of the child's life (7). This technique has been identified as the method that provides the best estimates in this age range (8), where parents and caregivers are responsible for recording the infant's dietary intake (2,9).
As for all dietary assessment methods, FDs are not exempt from error and bias from the criterion standard methods (10). In such a longitudinal multicentre study, there was a need to develop and implement SOPs with regard to data collection, the checking and interpretation of FDs, and the calculation and data introduction into the food database. Although there are validated methods for assessing the dietary intake of adults, there is a need for validated methods for assessing dietary intake in infancy and childhood (2,4). Specifically, in the present study, potential sources of error in measuring the dietary intake of infants who are fed reconstituted powdered formulas have been identified. Formula dilution, the interpretation of FDs by nutritionists, and the sequence of calculations needed to quantify the consumed amount of formula may all contribute to errors in the dietary assessment of formula-fed infants. For instance, parents do not always dilute powdered formulas according to the manufacturers’ instructions, which may lead to a reconstituted formula with an unknown nutrient density. Indeed, a systematic review identified errors in the reconstitution of a powdered formula milk preparation in all identified studies conducted in the United Kingdom (11). The present practices for the preparation of infant formula in other European countries (where the study was being conducted) are not known.
Another particular source of potential errors is that parents may not consider the increase in volume caused by the addition of powdered formula to water, which results in a larger volume of prepared formula than the amount of water used. Therefore, we considered it necessary to design specific FDs to allow proper data collection and checking and to standardise the procedures for FD interpretations and calculations in our multicentre study to reduce potential sources of error. Here we report on the frequency of errors made in diluting powdered formula and in reporting the total volume of formula milk by parents and caregivers, as well as the approach used to detect these errors and the experience gathered.
The aim of the present study was to develop, validate, and ensure the proper use of SOPs to assess the dietary intake of formula-fed infants, while identifying and correcting for potential sources of error.
A parallel cross-sectional observational study to validate the methods used to assess dietary intakes in formula-fed infants was designed.
Collection of Dietary Intake Data
A 3-day weighed FD was used to collect formula intake during the first year of life in the 5 countries taking part in the Childhood Obesity Project. Parents were asked to record everything consumed by the infant during a 3-day period (2 weekdays and 1 weekend day). FDs were designed to track bottle preparation (amounts of water, powdered formula and powdered cereals, where applicable) and the total offered and actually consumed volumes. This specially designed FD, where parents were asked to record all the details of the preparation of each bottle, allowed the nutritionists to detect cases in which parents diluted the formula deviating from manufacturers’ instructions, as well as cases in which water volume was reported instead of total offered volume. Further details have been published elsewhere (7,12).
Identification of Specific Sources of Error in the Preparation and Recording of Intakes of Infant Formula Milk by Parents and Caregivers
A random subsample of FDs that were kept between October 2002 and July 2005, during the first year of life of 100 infants participating in the study (20 infants from each country, ten 3-day FDs from each infant), was blindly selected (investigators from each study centre randomly took 20 children's folders without seeing any identifier). Using the diaries, the frequency of parental errors in diluting powdered formula milk and in reporting total milk volumes was analysed.
Nutritionists from the 5 study centres checked every single diary following the SOPs document to identify
1. Whether at least 1 bottle was prepared by parents or caregivers who did not follow the manufacturers’ instructions (leading to an infant formula of unknown nutritional composition).
2. Whether at least the total volume of one bottle was recorded without taking into account the volume increase produced by the addition of powdered formula and cereals.
The specific source of errors in reporting infant dietary intakes by parents or caregivers is analysed as a percentage of FDs with incorrectly prepared bottles (by the incorrect dilution of powdered formula) and the percentage of FDs with no correct total volumes offered and consumed.
The SOPs were developed to ensure a harmonised methodological approach by the nutritionists at all centres while evaluating the dietary protocols. To determine the mean volume increase by the addition of powdered formula and cereals to water, 10 tests were performed. In these tests, a mean weight of 4.7 g of formula was added to 30 mL of water in test tubes with a precision of 1 mL. The process was repeated for 6 different infant formulas and 3 different kinds of cereals. The established standard increase in volumes was 3 mL for each addition of one level scoopful of powdered formula and 6.5 mL for the addition of 10 g of powdered cereals.
Equations and procedures were established for different situations that could induce error, such as combinations of correct or incorrect formula reconstitution with incorrect recording of total volume. The following example illustrates the procedure:
If the preparation was 240 mL of water with 7 scoopfuls of powdered formula, the total amount prepared was 260 mL and the remaining volume was 65 mL. Thus, the total amount consumed would be 195 mL; however, the 195 mL of formula milk would have a nutritional composition unknown. Therefore, it is needed to translate 195 mL consumed into the corresponding volume of formula in which the nutrient composition is known. The needed calculations for this translation would be
1. The actual nutrient value of 7 formula scoopfuls would correspond to a preparation with 210 mL of water (to give a total volume of approximately 231 mL)
2. The infant consumed 75% of the bottle (195 mL of 260 mL)
3. Seventy-five percent of 231 mL is 173.25 mL.
Therefore, 195 mL of an unknown nutrient composition formula would be translated to approximately 173 mL of formula milk of known nutrient composition.
Or more briefly, in only 1 step:
Formula intake (VolFI) would be equal to [VolSTD-CO × VolCO]/VolOF,
where VolSTD-CO is the standard volume if the formula is correctly diluted (231 mL), VolCO is the consumed volume (195 mL), and VolOF is the offered volume (260 mL).
Table 1 shows the main equations included in the SOPs protocol used to calculate dietary intakes from food records containing formula milk not properly reported or diluted.
Because several variables are needed to complete the calculations (millilitres of water, number of scoopfuls, grams of cereals, offered volume, remaining volume), it is extremely important to perform a proper check of the FD with the reporters to obtain the highest data quality. Mandatory variables required to properly calculate nutrient intake are water volume, number of scoopfuls, and remaining volume. When checking the diary with the reporters is not possible, the assumptions to be made were standardised in the SOPs protocol. In the present study, when incorrect dilution information (the number of scoopfuls did not correspond to the water volume) was reported in the FDs, but it was not possible to check with the study participants, it was assumed to be a dilution error, rather than a typing error. In the case of inconsistency between the amount of ingredients and the offered volume, the protocol gave priority to the variables of water volume and number of scoopfuls rather than to the offered volume (because this was considered a frequent source of error, when the reporters did not take into account the increase in volume by the addition of powder to water).
To reduce potential errors in the nutritionists’ calculations as well as the time spent on the dietary assessment process, we developed a tool using Excel for Windows XP software (Microsoft; SOPsystem; Microsoft, Redmond, WA). The SOPsystem was developed considering the standard volumes and calculation procedures previously established in the protocol. Only the amounts of all bottle ingredients (water, powdered formula, and cereals) and the volume remaining after a meal needed to be entered in SOPsystem, and amounts of actual dietary intakes were then calculated by the software.
Nutritionists from the 5 different countries participating in the multicentre trial were trained to check and interpret the FDs, calculate dietary intakes following established standards, and use the SOPsystem.
Validation of the SOPs and the SOPsystem
To validate the SOPsystem, a simulated FD consisting of 25 bottles (9 of which also contained cereals) was designed.
Implementation of the SOPsystem by Trained Nutritionists
Nine trained nutritionists working on the project were invited to test the simulated FD interpretation and calculations using 2 different methods: performing the calculation using the SOPsystem or not using the SOPsystem for calculations, on the same 25 bottle-simulated diary. The results of this training were analysed and are described below.
Implementation of the SOPsystem by Nonexpert Nutritionists
As part of a nutrition university degree training session in dietary assessment methods in infants, a group of 23 Spanish nutrition university students not trained in infant formula intake assessment also performed the interpretation and calculation using the simulated FD. The students participated in an initial session with a brief explanation of the increase in volume produced by the addition of powdered milk and cereals to the water and different sources of error in infant formula intake assessment. At the end of this session, the nutrition students used a calculator to analyse the simulated FD. In a second session, they calculated the same simulated FD using the SOPsystem, after receiving an explanation about the software programme.
The validity of the implementation of the method was evaluated as the percentage of correct and incorrect answers. The correct volumes of formula for the simulated diary were agreed upon by 3 of the nutritionists trained in using the SOPs. Answers within ±2% of the agreed value were considered to be correct. This range around the agreement value was defined to determine a minimum error produced by decimal positions in calculations, but to avoid any real error in calculations produced by investigators. The ability of the SOPsystem to standardise nutritionists’ evaluations was tested using internutritionists’ variance coefficients. Additionally, the time spent to assess the simulated FD was analysed.
Descriptive results are presented as the mean (95% confidence interval). Kruskal-Wallis tests were used to assess differences by country in the parental reports of total volumes and formula dilutions. Differences in the frequency of correct answers using or not using the SOPsystem were evaluated by a McNemar test, using a ±2% value obtained as the correct answer. Absolute risk reduction (% [95% confidence interval]) was calculated to assess the reduction in the number of bottles calculated incorrectly using the SOPsystem. To analyse the internutritionist variance in the estimations of formula intake, the coefficient of variation (CV) for each bottle was calculated. To compare the internutritionist variation between the 2 methods, a paired samples Student t test or a Wilcoxon test (when not normally distributed) was performed. Normality was determined by the Kolmogorov-Smirnov Z test. The time spent on the evaluation of the simulated diary was measured, and a paired samples Student t test was used to compare the 2 methods. Statistical significance was accepted at P < 0.05. SPPS version 17.0 (SPSS Inc, Chicago, IL) was used to perform the statistical analysis. The European Childhood Obesity Project was approved by the ethical committees of all study centres.
Identification of Specific Sources of Error in Parental and Caregiver Preparation and Recording of Infants’ Formula Milk Intake
The analysis of the dietary protocols from the random subgroup of 100 infants (20 from each of the 5 countries) showed that 60% of parents reported incorrect total amounts of formula offered (ie, they did not take into account increasing volumes) in at least 1 of the FDs. Figure 1 shows the frequency of incorrectly reported total volumes in the random subsample at each time point. In the entire sample, the mean proportion of bottles incorrectly reported was 50.6% (43.0–58.1). There were significant differences by country in the frequency of incorrect reporting by parents or caregivers (P < 0.001). Parents incorrectly reported the total volume for 19.6% of the bottles in Germany, 38.0% in Belgium, 74.4% in Italy, 60.6% in Poland, and 59.9% in Spain. This evaluation also indicated that 37% of parents did not follow the manufacturers’ instructions for the dilution of infant formula in at least one of the FDs. Figure 2 shows the frequency of incorrectly diluted formula milk in the same random subsample by time point. In the entire sample, 8.3% (5.1–11.4) of the bottles were incorrectly diluted. We did not find significant differences by country in formula dilution.
Implementation of the SOPsystem
The analyses of the efficacy of implementation of the SOPsystem among trained nutritionists and nonexperienced nutritionists showed higher rates of correct answers using the SOPsystem than without in all cases, mostly with statistically significant differences (Table 2). Table 2 shows the frequency among trained nutritionists of correct and incorrect estimates for formula and powdered cereals using the SOPsystem versus not using it. Table 3 shows the frequency of correct and incorrect estimates by the inexperienced nutrition students. Each test (n) represents 1 calculated bottle by 1 observer. In other words, the evaluation of 25 bottles each performed by 9 nutritionists represents 225 evaluations. Nine of the 25 bottles were reported to contain cereals, representing 81 of the 225 evaluations. Comparisons are shown for all bottles assessed on the whole evaluation and for subanalyses on groups of bottles: bottles of formula correctly diluted with added cereals, bottles of formula diluted by not following the instructions (incorrectly diluted formula), and bottles of formula diluted by not following the instructions with powdered cereals added (incorrect preparation + cereals). Four columns show the results of the tests in percentages: (first) correctly by both methods, (second) incorrectly by both methods, (third) correctly by the SOPsystem and incorrectly without it, and (fourth) correctly without the SOPsystem and incorrectly with it.
The trained nutritionists had an 8.9% reduction in calculation errors in formula intake calculations and 18.5% in cereals (Table 2), whereas the nutrition students reduced by 43.8% errors in formula intake calculations and 55.6% in cereals (Table 3), both using the SOPsystem. In both cases, the absolute reduction of risk was the highest when the formula was diluted incorrectly and cereals were added.
The CV for each bottle was calculated per millilitre of formula and grams of cereal. Among trained nutritionists, the mean CV of the estimated formula was significantly lower (P = 0.005) using the SOPsystem (CV = 0.007) compared with not using it (CV = 0.014). The same pattern was observed for cereals (P < 0.046, CV = 0.008 for the SOPsystem and CV = 0.015 without the SOPsystem). The time required for the calculation was significantly shorter with the SOPsystem than without it (Table 4).
Identification of Specific Sources of Error in Parental and Caregiver Preparation and Recording of Infants’ Formula Milk Intake
We detected a high frequency of parental errors in reporting total formula volumes and diluting the powdered formula. These results highlight the need to use the specific formatted FDs in studies of formula-fed infants, improving the description of bottle preparation and allowing the identification of misleading formula dilutions or misreporting of total volumes offered to the infants. Thus, an FD for formula-fed infants should collect data on both the amounts of water and powdered formula used to prepare the bottles, as well as data on total volumes offered and remaining after each meal.
These results also highlight the need to provide more education to parents in relation to the reconstitution of powdered formulas. Incorrect formula dilution may have important nutritional risks, including a possible increase in kidney workload (13) or an increased risk of obesity (14). Lucas et al (14) reported increased weights and fat mass estimates among infants fed powdered formula compared with infants fed with a ready-to-feed formula.
The high frequency of the reconstitution of formula deviating from manufacturers’ instructions that we observed and the errors in total volume recorded by parents would lead to major differences in data interpretation unless a standardised approach to interpret FDs and determine the consumed amounts of reconstituted formula is applied. A possible weakness of this protocol may be the assumptions that should be performed in some situations. For instance, when the wrong dilution information was reported in FDs (the number of scoopfuls did not correspond to the water volume), but it was not possible to check with the study participants, it was assumed to be a dilution error, rather than an error in reporting water volume or the number of scoopfuls. This assumption could consider typing errors as dilution errors; however, this could also be considered strength of the protocol, ensuring consistent evaluation of FDs.
Implementation of SOPs and the SOPsystem
The different sequences of calculations required to determine dietary intake in different types of parental reports (if they do or do not take into account the increase in volume by the addition of powdered formula to the water, if they perform correct reconstitution of powdered formula, and combinations of both possibilities) enhance the need to standardise the evaluation of FDs. Moreover, the experience gained clearly shows the major advantages to using a software tool such as the SOPsystem to calculate dietary intakes of formula-fed infants in a multicentre setting, with respect to both the accuracy of the results and the work time needed to obtain these results.
The use of the SOPsystem for evaluation of infant formula intake consistently reduced observer error. Among nutritionists, the use of the SOPsystem was associated with a >3-fold success in performing the correct calculations. Among the less-experienced nutrition students, the use of the SOPsystem tool increased the probability of performing the calculations correctly, arriving at a 60-fold higher probability of success when the formula was incorrectly diluted. The lower internutritionist CVs obtained when using the SOPsystem demonstrate that this tool guarantees the constant use of SOPs, unifies the methodology among the observers, and reduces the magnitude of error. These results suggest that the SOPsystem may improve the work of inexperienced nutritionists, reducing the time and effort needed for their training in FD evaluation in this age range. The use of the SOPsystem reduced the time needed for calculations to an average of 25.6% of the time needed for manual calculations in nutrition students and 44.1% in nutritionists. Although trained nutritionists needed the same time for manual calculations as nutrition students, they performed much faster calculations using the SOPsystem. The main limitation of the present study could be that all nutritionists performed the calculations without the SOPsystem first, and with the SOPsystem second. This could lead to a potential risk of training effect, partially magnifying the effect of the SOPsystem. This could partly explain how trainee nutritionists would benefit more than the experienced nutritionists would from the use of the SOPsystem.
Based on the results obtained in the present study, the use of the SOPsystem rather than manual calculations for evaluating the approximately nine thousand 3-day FDs obtained during the first year of life in the infants participating in the European Childhood Obesity Project, including reports on an estimated 121,500 feeding bottles, would result in an avoidance of 10,935 calculation errors and save approximately 1112 hours of work, which is >7 person-months.
It has not been assessed how the reduction in the error rate may influence total daily intake estimations. A 2% difference in calculations would guarantee a high precision; however, we cannot avoid the error produced by the lack of precision in the graduation of feeding bottles; this would have a major impact on total daily intake.
The easy implementation of the SOPsystem by expert and inexperienced nutritionists highlights its feasibility and easy adaptability to any study evaluating the intake of powdered formulas in infants. Furthermore, this procedure could also be used after data entry if all requested variables were entered in the database. This would increase the speed and efficacy of the nutritional evaluation of formula-fed infants and the interest of these established SOPs.
We conclude that the development and implementation of SOPs with a software tool that identified and corrected specific sources of error resulted in a harmonised and improved process for assessing dietary intake in formula-fed infants, minimising errors in the calculations and reducing the work time invested.
We gratefully acknowledge all the research nutritionists who have ever participated in the Childhood Obesity Project for all their hard work. We are extremely grateful to Joan Fernández-Ballart (from the Universitat Rovira i Virgili) and Pilar Hernández (IISPV) for their lessons and advice on statistical analyses.