• Login
    View Item 
    •   Home
    • Massey Documents by Type
    • Internet Publication
    • View Item
    •   Home
    • Massey Documents by Type
    • Internet Publication
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Manipulating the alpha level cannot cure significance testing – comments on "Redefine statistical significance"

    Icon
    View/Open
    Icon
    10.7287/peerj.preprints.3411v1
    Open Access Location
    https://peerj.com/preprints/3411/
     
    Find Full Text
    Abstract
    We argue that depending on p-values to reject null hypotheses, including a recent call for changing the canonical alpha level for statistical significance from .05 to .005, is deleterious for the finding of new discoveries and the progress of science. Given that blanket and variable criterion levels both are problematic, it is sensible to dispense with significance testing altogether. There are alternatives that address study design and determining sample sizes much more directly than significance testing does; but none of the statistical tools should replace significance testing as the new magic method giving clear-cut mechanical answers. Inference should not be based on single studies at all, but on cumulative evidence from multiple independent studies. When evaluating the strength of the evidence, we should consider, for example, auxiliary assumptions, the strength of the experimental design, or implications for applications. To boil all this down to a binary decision based on a p-value threshold of .05, .01, .005, or anything else, is not acceptable.
    Citation
    2017
    Date
    2017-11-14
    Author
    Trafimov, D
    Amrhein, V
    Areshenkoff, CN
    Barrera - Causil, C
    Beh, EJ
    Bilgiç, Y
    Bono, R
    Bradley, MT
    Briggs, WM
    Cepeda - Freyre, HA
    Chaigneau, SE
    Ciocca, DR
    Correa, JC
    Cousineau, D
    de Boer, MR
    Dhar, SS
    Dolgov, I
    Gómez - Benito, J
    Grendar, M
    Grice, J
    Guerrero - Gimenez, ME
    Gutiérrez, A
    Huedo - Medina, TB
    Jaffe, K
    Janyan, A
    Karimnezhad, A
    Korner - Nievergelt, F
    Kosugi, K
    Lachmair, M
    Ledesma, R
    Limongi, R
    Liuzza, MT
    Lombardo, R
    Marks, M
    Meinlschmidt, G
    Nalborczyk, L
    Nguyen, HT
    Ospina, R
    Perezgonzalez, JD
    Pfister, R
    Rahona, JJ
    Rodríguez - Medina, DA
    Romão, X
    Ruiz - Fernández, S
    Suarez, I
    Tegethoff, M
    Tejo, M
    van de Schoot, R
    Vankov, I
    Velasco - Forero, S
    Wang, T
    Yamada, Y
    Zoppino, FCM
    Marmolejo - Ramos, F
    Publisher
    PeerJ Preprints
    https://peerj.com/preprints/3411v1/
    Collections
    • Internet Publication
    Metadata
    Show full item record

    Copyright © Massey University
    Contact Us | Send Feedback | Copyright Take Down Request | Massey University Privacy Statement
    DSpace software copyright © Duraspace
    v5.7-2020.1
     

     

    Tweets by @Massey_Research
    Information PagesContent PolicyDepositing content to MROCopyright and Access InformationDeposit LicenseDeposit License SummaryTheses FAQFile FormatsDoctoral Thesis Deposit

    Browse

    All of MROCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    Copyright © Massey University
    Contact Us | Send Feedback | Copyright Take Down Request | Massey University Privacy Statement
    DSpace software copyright © Duraspace
    v5.7-2020.1