Pub Date : 2024-10-01Epub Date: 2024-09-05DOI: 10.1177/00236772241247105
Naomi Altman, Martin Krzywinski
Variability is inherent in most biological systems due to differences among members of the population. Two types of variation are commonly observed in studies: differences among samples and the "error" in estimating a population parameter (e.g. mean) from a sample. While these concepts are fundamentally very different, the associated variation is often expressed using similar notation-an interval that represents a range of values with a lower and upper bound. In this article we discuss how common intervals are used (and misused).
{"title":"Depicting variability and uncertainty using intervals and error bars.","authors":"Naomi Altman, Martin Krzywinski","doi":"10.1177/00236772241247105","DOIUrl":"10.1177/00236772241247105","url":null,"abstract":"<p><p>Variability is inherent in most biological systems due to differences among members of the population. Two types of variation are commonly observed in studies: differences among samples and the \"error\" in estimating a population parameter (e.g. mean) from a sample. While these concepts are fundamentally very different, the associated variation is often expressed using similar notation-an interval that represents a range of values with a lower and upper bound. In this article we discuss how common intervals are used (and misused).</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":" ","pages":"453-457"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142140406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01Epub Date: 2024-08-19DOI: 10.1177/00236772241248509
Fulvio Magara, Benjamin Boury-Jamot
Absence of statistical significance (i.e., p > 0.05) in the results of a frequentist test comparing two samples is often used as evidence of absence of difference, or absence of effect of a treatment, on the measured variable. Such conclusions are often wrong because absence of significance may merely result from a sample size that is too small to reveal an effect. To conclude that there is no meaningful effect of a treatment/condition, it is necessary to use an appropriate statistical approach. For frequentist statistics, a simple tool for this goal is the 'two one-sided t-test,' a form of equivalence test that relies on the a priori definition of a minimal difference considered to be relevant. In other words, the smallest effect size of interest should be established in advance. We present the principles of this test and give examples where it allows correct interpretation of the results of a classical t-test assuming absence of difference. Equivalence tests are also very useful in probing whether certain significant results are also biologically meaningful, because when comparing large samples it is possible to find significant results in both an equivalence test and in a two-sample t-test, assuming no difference as the null hypothesis.
在比较两个样本的频数检验结果中,如果没有统计学意义(即 p > 0.05),通常会被用来证明在测量的变量上没有差异,或治疗没有效果。这种结论往往是错误的,因为没有显著性可能只是因为样本量太小,无法显示效果。要得出某项治疗/条件不存在有意义影响的结论,必须使用适当的统计方法。对于频数统计来说,实现这一目标的简单工具是 "两个单侧 t 检验",这是一种等效检验,它依赖于被认为相关的最小差异的先验定义。换句话说,应事先确定相关的最小效应大小。我们介绍了这种检验的原理,并举例说明了在假设无差异的情况下,它可以正确解释经典 t 检验的结果。等效检验在探究某些显著结果是否也具有生物学意义方面也非常有用,因为在比较大样本时,假设无差异为零假设,在等效检验和双样本 t 检验中都有可能发现显著结果。
{"title":"About statistical significance, and the lack thereof.","authors":"Fulvio Magara, Benjamin Boury-Jamot","doi":"10.1177/00236772241248509","DOIUrl":"10.1177/00236772241248509","url":null,"abstract":"<p><p>Absence of statistical significance (i.e., <i>p</i> > 0.05) in the results of a frequentist test comparing two samples is often used as evidence of absence of difference, or absence of effect of a treatment, on the measured variable. Such conclusions are often wrong because absence of significance may merely result from a sample size that is too small to reveal an effect. To conclude that there is no meaningful effect of a treatment/condition, it is necessary to use an appropriate statistical approach. For frequentist statistics, a simple tool for this goal is the 'two one-sided <i>t</i>-test,' a form of equivalence test that relies on the a priori definition of a minimal difference considered to be relevant. In other words, the smallest effect size of interest should be established in advance. We present the principles of this test and give examples where it allows correct interpretation of the results of a classical <i>t</i>-test assuming absence of difference. Equivalence tests are also very useful in probing whether certain significant results are also biologically meaningful, because when comparing large samples it is possible to find significant results in both an equivalence test and in a two-sample <i>t</i>-test, assuming no difference as the null hypothesis.</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":" ","pages":"448-452"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142000309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01DOI: 10.1177/00236772241276808
Romain-Daniel Gosselin
The normality assumption postulates that empirical data derives from a normal (Gaussian) population. It is a pillar of inferential statistics that enables the theorization of probability functions and the computation of p-values thereof. The breach of this assumption may not impose a formal mathematical constraint on the computation of inferential outputs (e.g., p-values) but may make them inoperable and possibly lead to unethical waste of laboratory animals. Various methods, including statistical tests and qualitative visual examination, can reveal incompatibility with normality and the choice of a procedure should not be trivialized. The following minireview will provide a brief overview of diagrammatical methods and statistical tests commonly employed to evaluate congruence with normality. Special attention will be given to the potential pitfalls associated with their application. Normality is an unachievable ideal that practically never accurately describes natural variables, and detrimental consequences of non-normality may be safeguarded by using large samples. Therefore, the very concept of preliminary normality testing is also, arguably provocatively, questioned.
正态性假设假定经验数据来自正常(高斯)群体。它是推理统计的支柱,使概率函数的理论化及其 p 值的计算成为可能。违反这一假设可能不会对推理输出(如 p 值)的计算造成正式的数学限制,但可能会使其无法操作,并可能导致实验动物的不道德浪费。各种方法,包括统计检验和定性直观检查,都可以发现不符合正态性的情况,因此不应轻视程序的选择。下面的小视图将简要介绍常用于评估是否符合正态性的图解法和统计检验法。我们将特别关注与这些方法的应用相关的潜在隐患。正态性是一个无法实现的理想,实际上永远无法准确描述自然变量,而使用大样本可以避免非正态性的有害后果。因此,初步正态性检验的概念本身也受到了质疑,可以说是挑衅性的质疑。
{"title":"Testing for normality: a user's (cautionary) guide.","authors":"Romain-Daniel Gosselin","doi":"10.1177/00236772241276808","DOIUrl":"https://doi.org/10.1177/00236772241276808","url":null,"abstract":"<p><p>The normality assumption postulates that empirical data derives from a normal (Gaussian) population. It is a pillar of inferential statistics that enables the theorization of probability functions and the computation of p-values thereof. The breach of this assumption may not impose a formal mathematical constraint on the computation of inferential outputs (e.g., p-values) but may make them inoperable and possibly lead to unethical waste of laboratory animals. Various methods, including statistical tests and qualitative visual examination, can reveal incompatibility with normality and the choice of a procedure should not be trivialized. The following minireview will provide a brief overview of diagrammatical methods and statistical tests commonly employed to evaluate congruence with normality. Special attention will be given to the potential pitfalls associated with their application. Normality is an unachievable ideal that practically never accurately describes natural variables, and detrimental consequences of non-normality may be safeguarded by using large samples. Therefore, the very concept of preliminary normality testing is also, arguably provocatively, questioned.</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":"58 5","pages":"433-437"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142372233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01Epub Date: 2024-08-19DOI: 10.1177/00236772241246602
Stanley E Lazic
Most classical statistical tests assume data are normally distributed. If this assumption is not met, researchers often turn to non-parametric methods. These methods have some drawbacks, and if no suitable non-parametric test exists, a normal distribution may be used inappropriately instead. A better option is to select a distribution appropriate for the data from dozens available in modern software packages. Selecting a distribution that represents the data generating process is a crucial but overlooked step in analysing data. This paper discusses several alternative distributions and the types of data that they are suitable for.
{"title":"Ditching the norm: Using alternative distributions for biological data analysis.","authors":"Stanley E Lazic","doi":"10.1177/00236772241246602","DOIUrl":"10.1177/00236772241246602","url":null,"abstract":"<p><p>Most classical statistical tests assume data are normally distributed. If this assumption is not met, researchers often turn to non-parametric methods. These methods have some drawbacks, and if no suitable non-parametric test exists, a normal distribution may be used inappropriately instead. A better option is to select a distribution appropriate for the data from dozens available in modern software packages. Selecting a distribution that represents the data generating process is a crucial but overlooked step in analysing data. This paper discusses several alternative distributions and the types of data that they are suitable for.</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":" ","pages":"438-442"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142000311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01Epub Date: 2024-09-24DOI: 10.1177/00236772241247106
Naomi Altman, Martin Krzywinski
P-values combined with estimates of effect size are used to assess the importance of experimental results. However, their interpretation can be invalidated by selection bias when testing multiple hypotheses, fitting multiple models or even informally selecting results that seem interesting after observing the data. We offer an introduction to principled uses of p-values (targeted at the non-specialist) and identify questionable practices to be avoided.
P 值与效应大小估计值相结合,用于评估实验结果的重要性。然而,在测试多个假设、拟合多个模型或甚至在观察数据后非正式地选择看起来有趣的结果时,其解释可能会因选择偏差而失效。我们将介绍 p 值的原则性用法(针对非专业人士),并指出应避免的可疑做法。
{"title":"Understanding <i>p</i>-values and significance.","authors":"Naomi Altman, Martin Krzywinski","doi":"10.1177/00236772241247106","DOIUrl":"10.1177/00236772241247106","url":null,"abstract":"<p><p><i>P-</i>values combined with estimates of effect size are used to assess the importance of experimental results. However, their interpretation can be invalidated by selection bias when testing multiple hypotheses, fitting multiple models or even informally selecting results that seem interesting after observing the data. We offer an introduction to principled uses of <i>p</i>-values (targeted at the non-specialist) and identify questionable practices to be avoided.</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":" ","pages":"443-447"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142308039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01Epub Date: 2024-09-20DOI: 10.1177/00236772241262829
Gary J Larson, Keith R Shockley
The theory and practice of statistics comprises two main schools of thought: frequentist statistics and Bayesian statistics. Frequentist methods are most commonly used to analyze animal-based laboratory data, while Bayesian statistical methods have been implemented less widely and may be relatively unfamiliar to practitioners in experimental science. This paper provides a high-level overview of Bayesian statistics and how they compare with frequentist methods. Using examples in rodent toxicity research, we argue that Bayesian methods have much to offer laboratory animal researchers. We advocate for increased attention to and adoption of Bayesian methods in laboratory animal research. Bayesian statistical theory, methods, software, and education have advanced significantly in the last 30 years, making these tools more accessible than ever.
{"title":"Bayesian statistical concepts with examples from rodent toxicology studies.","authors":"Gary J Larson, Keith R Shockley","doi":"10.1177/00236772241262829","DOIUrl":"10.1177/00236772241262829","url":null,"abstract":"<p><p>The theory and practice of statistics comprises two main schools of thought: frequentist statistics and Bayesian statistics. Frequentist methods are most commonly used to analyze animal-based laboratory data, while Bayesian statistical methods have been implemented less widely and may be relatively unfamiliar to practitioners in experimental science. This paper provides a high-level overview of Bayesian statistics and how they compare with frequentist methods. Using examples in rodent toxicity research, we argue that Bayesian methods have much to offer laboratory animal researchers. We advocate for increased attention to and adoption of Bayesian methods in laboratory animal research. Bayesian statistical theory, methods, software, and education have advanced significantly in the last 30 years, making these tools more accessible than ever.</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":" ","pages":"470-475"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11559269/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142290372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01Epub Date: 2024-09-24DOI: 10.1177/00236772241260905
Servan Luciano Grüninger, Florian Frommlet
Animal research often involves experiments in which the effect of several factors on a particular outcome is of scientific interest. Many researchers approach such experiments by varying just one factor at a time. As a consequence, they design and analyze the experiments based on a pairwise comparison between two groups. However, this approach uses unreasonably large numbers of animals and leads to severe limitations in terms of the research questions that can be answered. Factorial designs and analyses offer a more efficient way to perform and assess experiments with multiple factors of interest. We will illustrate the basic principles behind these designs, discussing a simple example with only two factors before suggesting how to design and analyze more complex experiments involving larger numbers of factors based on multiway analysis of variance.
{"title":"Half the price, twice the gain: How to simultaneously decrease animal numbers and increase precision with good experimental design.","authors":"Servan Luciano Grüninger, Florian Frommlet","doi":"10.1177/00236772241260905","DOIUrl":"10.1177/00236772241260905","url":null,"abstract":"<p><p>Animal research often involves experiments in which the effect of several factors on a particular outcome is of scientific interest. Many researchers approach such experiments by varying just one factor at a time. As a consequence, they design and analyze the experiments based on a pairwise comparison between two groups. However, this approach uses unreasonably large numbers of animals and leads to severe limitations in terms of the research questions that can be answered. Factorial designs and analyses offer a more efficient way to perform and assess experiments with multiple factors of interest. We will illustrate the basic principles behind these designs, discussing a simple example with only two factors before suggesting how to design and analyze more complex experiments involving larger numbers of factors based on multiway analysis of variance.</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":" ","pages":"411-418"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11528980/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142308035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01DOI: 10.1177/00236772241279473
Jordi L Tremoleda
{"title":"Our 61st Annual Meeting: An exciting programme is shaping up!","authors":"Jordi L Tremoleda","doi":"10.1177/00236772241279473","DOIUrl":"https://doi.org/10.1177/00236772241279473","url":null,"abstract":"","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":"58 5","pages":"499"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142372231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-01Epub Date: 2024-08-05DOI: 10.1177/00236772241244519
Natasha A Karp, Alan Sharpe, Benjamin Phillips
Pilots are small-scale initial experiments that are intended to guide the design of future, larger studies, with a view to increasing their effectiveness. In this statistical primer we highlight five common mistakes that limit the utility of pilot studies and provide practical guidance to avoid such errors and increase their effectiveness. The common thread connecting these mistakes is insufficient planning and over-interpretation of the results. This approach compromises the ultimate goals of the research programme and the future experimental cascade. In support of our view that over-interpretation is an error, we present a simple simulation to demonstrate that pilots will generally generate an inaccurate estimate of the variability of the biological endpoint under study and that frequent under-estimation will lead to inconclusive and unethical subsequent experiments. We argue that well planned pilots are an important part of the research cascade and still need to be implemented to a high standard.
{"title":"Preclinical pilot studies: Five common pitfalls and how to avoid them.","authors":"Natasha A Karp, Alan Sharpe, Benjamin Phillips","doi":"10.1177/00236772241244519","DOIUrl":"10.1177/00236772241244519","url":null,"abstract":"<p><p>Pilots are small-scale initial experiments that are intended to guide the design of future, larger studies, with a view to increasing their effectiveness. In this statistical primer we highlight five common mistakes that limit the utility of pilot studies and provide practical guidance to avoid such errors and increase their effectiveness. The common thread connecting these mistakes is insufficient planning and over-interpretation of the results. This approach compromises the ultimate goals of the research programme and the future experimental cascade. In support of our view that over-interpretation is an error, we present a simple simulation to demonstrate that pilots will generally generate an inaccurate estimate of the variability of the biological endpoint under study and that frequent under-estimation will lead to inconclusive and unethical subsequent experiments. We argue that well planned pilots are an important part of the research cascade and still need to be implemented to a high standard.</p>","PeriodicalId":18013,"journal":{"name":"Laboratory Animals","volume":" ","pages":"481-485"},"PeriodicalIF":1.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141893767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}