1.1
In your experience, how often do researchers conducting epidemiology studies using biomonitoring data for exposure assessments consider the variability (between- and within-person) in the exposure metric?
Results
(9 Answers)
Answer Explanations
- Hardly ever SometimesExpert 3In my research projects, my collaborators consistently consider both between- and within-person exposure variability. However, I recognize that this group is somewhat unique in this regard, as they were among the pioneers in developing these concepts (Kromhout, Vermeulen, Heederik, Brunekreef, Burstyn). Outside of my group, I have encountered only one research team from Finland that also accounted for between- and within-person variability. To date, I have personally not come across a U.S.-based health research group led by MDs that has incorporated this consideration. I have only reviewed one article that addressed between- and within-person variability, although this is emphasized in the leading textbook (Quantitative Exposure Assessment by Lawrence Kupper and Steven Rappaport) on quantitative exposure assessment.
- SometimesExpert 4Depends on data availability, if multiple measurements are available most researchers will use all of them, and sometimes may even exclude participants with too few measurements.
- SometimesExpert 6This emphasis make this paper a useful contribution.
- SometimesExpert 7There is an increasing recognition of the importance of considering both between- and within-person variability in epidemiology studies using biomonitoring data. However, cost considerations often require choosing between enrolling more subjects vs making more measurments. Prior knowledge of between- and within-person variability is needed for best study design but is rarely available.
- SometimesExpert 1There are obviously numerous factors to consider, these include sample size, timing of biomonitoring measurements (hourly, daily, weekly, etc...), assessment of confounding factors (e.g., diet), purpose of biomonitoring (e.g., athletes for drug assessment), and the type of testing method used including type of sample used (e.g., urine, sweat, tears, etc...). Studies sometimes assess both between and within variability, but this is not always the case.
- Most of the timeExpert 9Most researchers I know consider all likely sources of variability (both between- and within-person) in designing studies or critiquing other studies. They might not do so explicitly in sample size calculations, but might consider it implicitly for example, by increasing overall sample size to account (partially) for within-person variation, or by other approaches to decrease within-person variation (such as taking 24-hour voids or first morning void for urine specimens).
- SometimesExpert 8Often there are some measures of between- and within-person variability described, but not always. I would not say 'most of the time'. Between person is more often reported than within person. Also depends on the study design, e.g. whether longitudinal data are available.
- Most of the timeExpert 5Overall, I think that most epidemiologists don't often consider the "within" variation for individuals, but almost always consider the between variation as that measure is necessary to know (or estimate) for basic sample size calculations.
Those epidemiologists who work primarily on studies using biomonitoring are well aware of the within-individual variation and the effects of this and repeated measurements on exposure measurement error, study power, and bias in risk estimates.
Generally, we don't have good estimates (from the field) of either within or between variation to assist with sample size/power estimations. - Most of the timeExpert 2The consideration of variability (both between-person and within-person) in exposure metrics has become increasingly common in epidemiology studies using biomonitoring data. Over the past two decades, the importance of accounting for variability has been widely recognized, driven by the understanding that ignoring it can lead to exposure misclassification and biased results.Many studies now incorporate designs and statistical methods that address variability, such as repeated measures and mixed-effects models. This shows that researchers are mindful of variability in their assessments. Additionally, the trend towards following guidelines and best practices (such as WHO’s Biological Monitoring of Chemical Exposure in the Workplace, EFSA’s Human biomonitoring data collection from occupational exposure to pesticides) has led to more consistent reporting on how variability is handled, especially in studies published in reputable journals.However, there are still instances where variability might not be fully considered, particularly in studies with limited resources or less experienced researchers. In these cases, variability may be acknowledged but not thoroughly addressed, or it might be overlooked due to practical constraints.The frequency of considering variability also varies depending on the study context, such as the population being studied and the nature of the exposure. Occupational studies, might be more rigorous in this regard compared to some environmental studies where repeated measures are harder to obtain.In summary, addressing variability is often practiced but not yet universally guaranteed. The field has made significant progress, but there is still room for improvement in ensuring that variability is consistently and thoroughly considered across all contexts.
Expert 6
Expert 9
Regarding Question 1.1: I suspect the variability in our responses might be due at least partly to different interpretations of the broad phrasing of the question. For example, I chose to interpret "consider" generally as "think about" and not rigorously as "include directly when doing sample size calculations". Furthermore and as others have mentioned, I believe most epidemiologists use between-person variability in sample size calculations as it is usually required. Within-person variability seems to be less commonly included in those calculations in my experience. And consideration of both types of variability is limited by factors such as availability of data, and/or not be described in detail in the Methods section of published articles.
Expert 2
Expert 3
Expert 1
Expert 5
Expert 8
-Part of the discrepancy in our original responses indeed seems to stem from a more semantic issue, from different interpretations of 'consider'. Maybe we can clarify this in the next round to improve our discussion.
-Expert 3 noted a difference in approach between European and US-based research groups. It would be interesting to explore this further, e.g.; is there a difference in regional guidelines or established practices? Or is this disparity more field-specific; are European groups more active in specific fields where variability consideration is more common? In general, this suggests a need for more collaboration and harmonization of approaches.
-Expert 1 and others already mentioned the crucial trade-offs between sample size and repeated measures. This balance is a key topic in this discussion, as resources are always constraint.