Results
(9 Answers)

Jump to Debate

Answer Explanations

  • Somewhat useful
    Expert 9
    Usefulness likely varies with the exposure(s) and the available data on variability associated with them.
  • Somewhat useful
    Expert 3
     The calculators seem more like a textbook, where individual aspects are presented separately for understanding. The properties of the calculators appear to be interrelated, and I would expect a single calculator that combines all these properties for a more comprehensive analysis. 
  • Somewhat useful
    Expert 4
    It is useful at study design stage to maximise the statistical power by different combinations of repeated measurements and sample size. 
  • Somewhat useful
    Expert 6
    They would be more useful if they did a better job of explaining the units of the component parameters, such as the mean, standard deviation, variance, desired margin of error, and minimal detectable effect.  Most of these parameters are expressed as standardized (SD) units, which may not be easily interpretable by readers.
  • Somewhat useful
    Expert 7
    Calculators are useful, however their use
    requires lots of info not usually available.
    What if ICC is unknown?
  • Extremely useful
    Expert 1
    Being able to see the differences in Power, Sample Size and Measurement error allow the scientist great flexibility to see given the limitations of funding, sample size, the exact values for Power that can be reached.
  • Somewhat useful
    Expert 8
    Definitely useful, as always, simple easy to use calculators come with a trade-off of flexibility in making changes by the researcher. But those that have ample experience will likely do them themselves or know how to handle their specific data and assumptions. For those that are less familiar and would otherwise maybe not calculate power taking into account measurement errors this will be extremely helpful. 
  • Somewhat useful
    Expert 5
    I think these are most useful for individuals who typically don't do sample size or power calculations incorporating measures of within-individual variation or exposure measurement error.  
    In my area of research (occupational/environmental epi), Epidemiologists/Statisticians would typically write their own programs (in SAS or R) to estimate sample sizes and tailor them to their specific study. 
  • Somewhat useful
    Expert 2
     While the calculators presented in the white paper offer valuable insights and tools for optimizing study design in the presence of classical measurement error, I would characterize them as "somewhat useful." This is because the calculators focus on basic and classic scenarios, such as additive, normally distributed measurement errors, which may not fully capture the complexities of many real-world epidemiological studies. For instance, they do not account for the presence of confounders, which are critical in most epidemiological analyses. Moreover, the calculators do not consider different study designs, such as cohort studies, case-control studies, or time-to-event analyses, which have unique statistical requirements and challenges. Without these considerations, the applicability of the calculators is limited to a narrower set of circumstances, making them somewhat useful but not universally applicable for all epidemiological research contexts. 
    Nevertheless, the calculators offer a convenient and free alternative to more expensive commercial software for sample size and power determination, such as PASS, and they help avoid the need for advanced programming in statistical software like SAS or Stata. 

Debate (5 Comments)

Back to Top
3
Expert 4
09/01/2024 12:33
Expert 5's comment about writing own programs for sample size estimation is a reality. If the authors' targets are epidemiologists / statisticians, they need to improve the flexibility of the calculator.
4
Expert 2
09/03/2024 07:47
I believe the target audience for these tools is not statisticians or epidemiologists, as there are already many complex and specialized packages available to address these issues. Instead, these tools are designed for those with less expertise in power or sample size calculation, but who are still aware of the variability within and between individuals. As I previously mentioned, simplified and user-friendly tools are needed to reach a broader audience.
2
Expert 5
09/11/2024 11:39
These responses indicate to me that the calculators may be most useful for researchers not well trained in these concepts, as expert 2 says - to reach a broader audience.  

I would add that we always encourage our students/colleagues to consult with a statistician/epidemiologist (especially if they are clinical/MDs) prior to submitting any grant application/initiating research/and ongoing.  Calculators may be handy for sample size and power calculations, but more advanced expertise is usually needed.
1
Expert 8
09/12/2024 14:47
There seems to be a consensus that these calculators are mostly useful for researchers less experienced in power calculations and that those with more expertise will likely require/prefer more flexibility for more complex data. 
0
Expert 7
09/13/2024 01:36
As we judge that these calculators and sample size calculations in general mostly useful,  it might be helpful to discuss limitations of such calculations.  Is anyone aware of a comparison between sample size calculations and the resulting sample size of studies (due to missing data, resource limitations etc.)
Comments are closed for this page.