Manipulating the alpha level cannot cure significance testing – comments on "Redefine statistical significance"

Simple item page
dc.contributor.authorTrafimov D
dc.contributor.authorAmrhein V
dc.contributor.authorAreshenkoff CN
dc.contributor.authorBarrera - Causil C
dc.contributor.authorBeh EJ
dc.contributor.authorBilgiç Y
dc.contributor.authorBono R
dc.contributor.authorBradley MT
dc.contributor.authorBriggs WM
dc.contributor.authorCepeda - Freyre HA
dc.contributor.authorChaigneau SE
dc.contributor.authorCiocca DR
dc.contributor.authorCorrea JC
dc.contributor.authorCousineau D
dc.contributor.authorde Boer MR
dc.contributor.authorDhar SS
dc.contributor.authorDolgov I
dc.contributor.authorGómez - Benito J
dc.contributor.authorGrendar M
dc.contributor.authorGrice J
dc.contributor.authorGuerrero - Gimenez ME
dc.contributor.authorGutiérrez A
dc.contributor.authorHuedo - Medina TB
dc.contributor.authorJaffe K
dc.contributor.authorJanyan A
dc.contributor.authorKarimnezhad A
dc.contributor.authorKorner - Nievergelt F
dc.contributor.authorKosugi K
dc.contributor.authorLachmair M
dc.contributor.authorLedesma R
dc.contributor.authorLimongi R
dc.contributor.authorLiuzza MT
dc.contributor.authorLombardo R
dc.contributor.authorMarks M
dc.contributor.authorMeinlschmidt G
dc.contributor.authorNalborczyk L
dc.contributor.authorNguyen HT
dc.contributor.authorOspina R
dc.contributor.authorPerezgonzalez JD
dc.contributor.authorPfister R
dc.contributor.authorRahona JJ
dc.contributor.authorRodríguez - Medina DA
dc.contributor.authorRomão X
dc.contributor.authorRuiz - Fernández S
dc.contributor.authorSuarez I
dc.contributor.authorTegethoff M
dc.contributor.authorTejo M
dc.contributor.authorvan de Schoot R
dc.contributor.authorVankov I
dc.contributor.authorVelasco - Forero S
dc.contributor.authorWang T
dc.contributor.authorYamada Y
dc.contributor.authorZoppino FCM
dc.contributor.authorMarmolejo - Ramos F
dc.date.accessioned2023-10-19T20:38:18Z
dc.date.available2017-11-14
dc.date.available2023-10-19T20:38:18Z
dc.date.issued2017-11-14
dc.description.abstractWe argue that depending on p-values to reject null hypotheses, including a recent call for changing the canonical alpha level for statistical significance from .05 to .005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable criterion levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and determining sample sizes much more directly than significance testing does; but none of the statistical tools should replace significance testing as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, or implications for applications. To boil all this down to a binary decision based on a p-value threshold of .05, .01, .005, or anything else, is not acceptable.
dc.identifierhttps://peerj.com/preprints/3411v1/
dc.identifier.citation2017
dc.identifier.doi10.7287/peerj.preprints.3411v1
dc.identifier.elements-id397042
dc.identifier.harvestedMassey_Dark
dc.identifier.urihttp://hdl.handle.net/10179/20258
dc.publisherPeerJ Preprints
dc.publisher.urihttps://peerj.com/preprints/3411v1/
dc.relation.urihttps://peerj.com/preprints/3411/
dc.subjectStatistics
dc.subjectBayes factor
dc.subjectReplicability
dc.subjectNHST
dc.subjectSignificance
dc.subjectp-value
dc.titleManipulating the alpha level cannot cure significance testing – comments on "Redefine statistical significance"
dc.typeinternet
pubs.notesNot known
pubs.organisational-group/Massey University
pubs.organisational-group/Massey University/Massey Business School
pubs.organisational-group/Massey University/Massey Business School/School of Aviation
Files
Collections
Internet Publication