When is statistical significance not significant?

Brazilian Political Science Review

Endereço:
Avenida Professor Luciano Gualberto, 315 - Cidade Universitária
São Paulo / SP
Site: https://brazilianpoliticalsciencereview.org/
Telefone: (11) 3091-3780
ISSN: 19813821
Editor Chefe: Adrian Gurza Lavalle
Início Publicação: 31/12/2006
Periodicidade: Quadrimestral
Área de Estudo: Ciência política

When is statistical significance not significant?

Ano: 2013 | Volume: 7 | Número: 1
Autores: Dalson Britto Figueiredo Filho, Ranulfo Paranhos, Enivaldo C. da Rocha, Mariana Batista, José Alexandre da Silva Jr., Manoel L. Wanderley D. Santos, Jacira Guiro Marino
Autor Correspondente: Dalson Britto Figueiredo Filho | [email protected]

Palavras-chave: p value statistics; statistical significance; significance tests.

Resumos Cadastrados

Resumo Inglês:

The article provides a non-technical introduction to the p value statistics. Its main purpose is to help researchers make sense of the appropriate role of the p value statistics in empirical political science research. On methodological grounds, we use replication, simulations and observational data to show when statistical significance is not significant. We argue that: (1) scholars must always graphically analyze their data before interpreting the p value; (2) it is pointless to estimate the p value for non-random samples; (3) the p value is highly affected by the sample size, and (4) it is pointless to estimate the p value when dealing with data on population.