Results
(9 Answers)

Jump to Debate

Answer Explanations

  • Hardly ever Sometimes
    Expert 3
     In my research projects, my collaborators consistently consider both between- and within-person exposure variability. However, I recognize that this group is somewhat unique in this regard, as they were among the pioneers in developing these concepts (Kromhout, Vermeulen, Heederik, Brunekreef, Burstyn). Outside of my group, I have encountered only one research team from Finland that also accounted for between- and within-person variability. To date, I have personally not come across a U.S.-based health research group led by MDs that has incorporated this consideration. I have only reviewed one article that addressed between- and within-person variability, although this is emphasized in the leading textbook (Quantitative Exposure Assessment by Lawrence Kupper and Steven  Rappaport) on quantitative exposure assessment.  
  • Sometimes
    Expert 4
    Depends on data availability, if multiple measurements are available most researchers will use all of them, and sometimes may even exclude participants with too few measurements. 
  • Sometimes
    Expert 6
    This emphasis make this paper a useful contribution.
  • Sometimes
    Expert 7
    There is an increasing recognition of the importance of considering both between- and within-person variability in epidemiology studies using biomonitoring data. However, cost considerations often require choosing between enrolling more subjects vs making more measurments.  Prior knowledge of between- and within-person variability is needed for best study design but is rarely available.
  • Sometimes
    Expert 1
    There are obviously numerous factors to consider, these include sample size, timing of biomonitoring measurements (hourly, daily, weekly, etc...), assessment of confounding factors (e.g., diet), purpose of biomonitoring (e.g., athletes for drug assessment), and the type of testing method used including type of sample used (e.g., urine, sweat, tears, etc...). Studies sometimes assess both between and within variability, but this is not always the case. 
  • Most of the time
    Expert 9
    Most researchers I know consider all likely sources of variability (both between- and within-person) in designing studies or critiquing other studies.  They might not do so explicitly in sample size calculations, but might consider it implicitly for example, by increasing overall sample size to account (partially) for within-person variation, or by other approaches to decrease within-person variation (such as taking 24-hour voids or first morning void for urine specimens).
  • Sometimes
    Expert 8
    Often there are some measures of between- and within-person variability described, but not always. I would not say 'most of the time'. Between person is more often reported than within person. Also depends on the study design, e.g. whether longitudinal data are available. 
  • Most of the time
    Expert 5
    Overall, I think that most epidemiologists don't often consider the "within" variation for individuals, but almost always consider the between variation as that measure is necessary to know (or estimate) for  basic sample size calculations.  

    Those epidemiologists who work primarily on studies using biomonitoring are well aware of the within-individual variation and the effects of this and repeated measurements on exposure measurement error, study power, and bias in risk estimates.  

    Generally, we don't have good estimates (from the field) of either within or between variation to assist with sample size/power estimations. 
  • Most of the time
    Expert 2
    The consideration of variability (both between-person and within-person) in exposure metrics has become increasingly common in epidemiology studies using biomonitoring data. Over the past two decades, the importance of accounting for variability has been widely recognized, driven by the understanding that ignoring it can lead to exposure misclassification and biased results.

    Many studies now incorporate designs and statistical methods that address variability, such as repeated measures and mixed-effects models. This shows that researchers are mindful of variability in their assessments. Additionally, the trend towards following guidelines and best practices (such as WHO’s Biological Monitoring of Chemical Exposure in the Workplace, EFSA’s Human biomonitoring data collection from occupational exposure to pesticides) has led to more consistent reporting on how variability is handled, especially in studies published in reputable journals.

    However, there are still instances where variability might not be fully considered, particularly in studies with limited resources or less experienced researchers. In these cases, variability may be acknowledged but not thoroughly addressed, or it might be overlooked due to practical constraints. 

    The frequency of considering variability also varies depending on the study context, such as the population being studied and the nature of the exposure. Occupational studies, might be more rigorous in this regard compared to some environmental studies where repeated measures are harder to obtain.

    In summary, addressing variability is often practiced but not yet universally guaranteed. The field has made significant progress, but there is still room for improvement in ensuring that variability is consistently and thoroughly considered across all contexts.

Debate (7 Comments)

Back to Top
0
Expert 6
08/31/2024 11:39
Why is the number of answers (and number of experts) = 9, while the graph shows 10 responses?
1
Expert 9
08/31/2024 13:25
In response to Expert 6:  It looks like Expert 3 gave two responses.

Regarding Question 1.1:  I suspect the variability in our responses might be due at least partly to different interpretations of the broad phrasing of the question.  For example, I chose to interpret "consider" generally as "think about" and not rigorously as "include directly when doing sample size calculations".  Furthermore and as others have mentioned, I believe most epidemiologists use between-person variability in sample size calculations as it is usually required.  Within-person variability seems to be less commonly included in those calculations in my experience.  And consideration of both types of variability is limited by factors such as availability of data, and/or not be described in detail in the Methods section of published articles.
5
Expert 2
09/03/2024 07:15
Although I recognize the awareness and application of statistical methods to account for between- and within-person variability in epidemiology studies, as Expert 3 points out, the application of such practices is far from universal. Often, these practices are restricted to well-resourced groups or those with specific expertise. This raises concerns about the overall reliability of epidemiological findings, especially those from under-resourced settings or non-expert groups. Moreover, the practical challenges of incorporating such variability—highlighted by the need for extensive measurements and additional resources—suggest that its regular consideration might be more idealistic than realistic for many studies. This underlines a significant divide: while the theoretical importance of considering variability is clear, the actual practice is hindered by logistical and educational barriers. This situation underscores the need for more standardized practices, better resource allocation, and accessible tools in the epidemiological community.
3
Expert 3
09/08/2024 14:52
 Expert 2 has well summarized the issues: actual practice is hindered by logistical and educational barriers. Expert 5 has pointed out an interesting aspect that I have observed but had not considered before—the "within" variation is not as commonly addressed as between-subject variation. I would add that I have seen this both among epidemiologists and toxicologists. It is more common to have more subjects than to take repeated measurements. I wonder if there is another barrier, in addition to education, logistics, and finances, such as cognitive bias or a preference for simpler study designs. 
2
Expert 1
09/09/2024 00:47
The process of conducting biomonitoring studies with adequate Power (sample size) and repeated measures is a balancing act. Usually there are trade offs (i.e., larger sample size and less repeated measures or smaller sample size and more repeated measures). In addition, the application area  (e.g., Forensic, Clinical, Sports Medicine, Environmental) will also affect these factors and the metabolite/chemical being measured and the technique plays a role. I agree with Expert 2 that the within variation is not usually addressed but again this depends on the purpose for biomonitoring. If I was measuring a chemical/motabolite in an athlete within variation would be critical over time.   
1
Expert 5
09/11/2024 11:18
It seems from the various expert comments, that the consideration of within-subject variation is very dependent on the application area (Expert 1), the expertise of the research group (and here I would say that the Europeans are more advanced in their approach), and the background of the Principal Scientists initiating the work.  I personally find that individuals trained in exposure assessment/science or industrial hygiene, and those who have real-world field experience collecting exposure (air, dermal etc.) and biological monitoring samples will consider all of the possible sources of variation (including variation in chemical analysis results) that could affect epidemiological study power and risk estimates. 
1
Expert 8
09/12/2024 13:28
Good discussion, I think many points have been addressed already. Some notes from my side: 
-Part of the discrepancy in our original responses indeed seems to stem from a more semantic issue, from different interpretations of 'consider'. Maybe we can clarify this in the next round to improve our discussion.
-Expert 3 noted a difference in approach between European and US-based research groups. It would be interesting to explore this further, e.g.; is there a difference in regional guidelines or established practices? Or is this disparity more field-specific; are European groups more active in specific fields where variability consideration is more common? In general, this suggests a need for more collaboration and harmonization of approaches. 
-Expert 1 and others already mentioned the crucial trade-offs between sample size and repeated measures. This balance is a key topic in this discussion, as resources are always constraint. 

Comments are closed for this page.