Sunday , June 26 2022
Home / Lars P. Syll / Significance testing and the real tasks of social science

# Significance testing and the real tasks of social science

Summary:
Significance testing and the real tasks of social science After having mastered all the technicalities of regression analysis and econometrics, students often feel as though they are masters of the universe. I usually cool them down with the required reading of Christopher Achen’s modern classic Interpreting and Using Regression. It usually gets​ them back on track again, and they understand that no increase in methodological sophistication … alter the fundamental nature of the subject. It remains a wondrous mixture of rigorous theory, experienced judgment, and inspired guesswork. And that, finally, is its charm. And in case they get too excited about having learned to master the intricacies of proper significance tests and p-values, I ask them to also

Topics:
Lars Pålsson Syll considers the following as important:

This could be interesting, too:

Lars Pålsson Syll writes Propensity scores — bias-reduction gone awry

Lars Pålsson Syll writes Bayesian absurdities

Lars Pålsson Syll writes The geometry of Bayes theorem

Lars Pålsson Syll writes Mindless statistics

## Significance testing and the real tasks of social science

After having mastered all the technicalities of regression analysis and econometrics, students often feel as though they are masters of the universe. I usually cool them down with the required reading of Christopher Achen’s modern classic Interpreting and Using Regression. It usually gets​ them back on track again, and they understand that

no increase in methodological sophistication … alter the fundamental nature of the subject. It remains a wondrous mixture of rigorous theory, experienced judgment, and inspired guesswork. And that, finally, is its charm.

And in case they get too excited about having learned to master the intricacies of proper significance tests and p-values, I ask them to also ponder on Achen’s apt warning:

Significance testing as a search for specification errors substitutes calculations for substantive thinking. Worse, it channels energy toward the hopeless search for functionally correct specifications and diverts​ attention from the real tasks, which are to formulate a manageable description of the data and to exclude competing ones.

Professor at Malmö University. Primary research interest - the philosophy, history and methodology of economics.