Sunday , May 5 2024
Home / Lars P. Syll / When should we believe the unconfoundedness assumption?

When should we believe the unconfoundedness assumption?

Summary:
[embedded content] Economics may be an informative tool for research. But if its practitioners do not investigate and make an effort of providing a justification for the credibility of the assumptions on which they erect their building, it will not fulfil its task. There is a gap between its aspirations and its accomplishments, and without more supportive evidence to substantiate its claims, critics — like yours truly — will continue to consider its ultimate arguments as a mixture of rather unhelpful metaphors and metaphysics. In mainstream economics, there is an excessive focus on formal modelling and statistics. The models and the statistical (econometric) machinery build on — often hidden and non-argued for — assumptions that are unsupported by data and whose veracity is

Topics:
Lars Pålsson Syll considers the following as important:

This could be interesting, too:

Lars Pålsson Syll writes Monte Carlo simulation explained (student stuff)

Lars Pålsson Syll writes The importance of ‘causal spread’

Lars Pålsson Syll writes Applied econometrics — a messy business

Lars Pålsson Syll writes Feynman’s trick (student stuff)


Economics may be an informative tool for research. But if its practitioners do not investigate and make an effort of providing a justification for the credibility of the assumptions on which they erect their building, it will not fulfil its task. There is a gap between its aspirations and its accomplishments, and without more supportive evidence to substantiate its claims, critics — like yours truly — will continue to consider its ultimate arguments as a mixture of rather unhelpful metaphors and metaphysics.

In mainstream economics, there is an excessive focus on formal modelling and statistics. The models and the statistical (econometric) machinery build on — often hidden and non-argued for — assumptions that are unsupported by data and whose veracity is highly uncertain.

Econometrics fails miserably over and over again. One reason is that the unconfoundedness assumption does not hold. Another important reason why it does is that the error term in the regression models used is thought of as representing the effect of the variables that were omitted from the models. The error term is somehow thought to be a ‘cover-all’ term representing omitted content in the model and necessary to include to ‘save’ the assumed deterministic relation between the other random variables included in the model. Error terms are usually assumed to be orthogonal (uncorrelated) to the explanatory variables. But since they are unobservable, they are also impossible to empirically test. And without justification of the orthogonality assumption, there is, as a rule, nothing to ensure identifiability:

When should we believe the unconfoundedness assumption?With enough math, an author can be confident that most readers will never figure out where a FWUTV (facts with unknown truth value) is buried. A discussant or referee cannot say that an identification assumption is not credible if they cannot figure out what it is and are too embarrassed to ask.

Distributional assumptions about error terms are a good place to bury things because hardly anyone pays attention to them. Moreover, if a critic does see that this is the identifying assumption, how can she win an argument about the true expected value the level of aether? If the author can make up an imaginary variable, “because I say so” seems like a pretty convincing answer to any question about its properties.

Paul Romer

Advertisements
Lars Pålsson Syll
Professor at Malmö University. Primary research interest - the philosophy, history and methodology of economics.

Leave a Reply

Your email address will not be published. Required fields are marked *