by Guest post by Jeff Mosenkis of Innovations for Poverty Action. The links are back from vacation. We may have a few back links to catch up on over the next weeks, so here we go: Rachel Meager has public speaking tips for economists. If you want to catch up on a Twitter conversation including me, Chris, and a bunch of other people responding to the Cuddy article on what replication fights in psych mean for econ there’s a 168-slide storify here. I wondered if econ is happily driving along at 65 mph waving at psych as it heads towards its own cliff, because I think every field is unaware of its own blind spots. For econ, I thought it wouldn’t be small samples, but lack of attention to the survey questions and what their measurement tools are getting at (in my experience other social science
Topics:
Jeff Mosenkis (IPA) considers the following as important: academia, development, Economics, links, miscellany, replications, reproducibility, Research, science, statistics
This could be interesting, too:
Lars Pålsson Syll writes Debunking mathematical economics
Merijn T. Knibbe writes ´Extra Unordinarily Persistent Large Otput Gaps´ (EU-PLOGs)
Peter Radford writes The Geology of Economics?
Lars Pålsson Syll writes Årets ‘Nobelpris’ i ekonomi — gammal skåpmat!
Guest post by Jeff Mosenkis of Innovations for Poverty Action.
The links are back from vacation. We may have a few back links to catch up on over the next weeks, so here we go:
- Rachel Meager has public speaking tips for economists.
- If you want to catch up on a Twitter conversation including me, Chris, and a bunch of other people responding to the Cuddy article on what replication fights in psych mean for econ there’s a 168-slide storify here.
- I wondered if econ is happily driving along at 65 mph waving at psych as it heads towards its own cliff, because I think every field is unaware of its own blind spots. For econ, I thought it wouldn’t be small samples, but lack of attention to the survey questions and what their measurement tools are getting at (in my experience other social science fields sweat these details far more than economists).
- But a few days later I was proven wrong. Stanford statistician John Ioannidis (known for the paper showing most medical studies are probably wrong), and colleagues came out with a paper showing most empirical econ studies are underpowered (using 159 meta-analysis data sets of 6,900 studies). In plain language that means they in fact didn’t have big enough samples to support the effects they claim:
nearly 80% of the reported effects in these empirical economics literatures are exaggerated; typically, by a factor of two and with one-third inflated by a factor of four or more.
The paper‘s part of a section on reproducibility in econ (all papers ungated), but there are some slides here in more accessible language. (h/t Lee Crawfurd)
- If misery loves company, a Nature survey of 1,500+ physical scientists found that more than 70% had tried and failed to reproduce another researcher’s experiments, and more than 50% had failed to reproduce their own experiments. Of the group that had tried to publish replications, successful replications were more frequently published than unsuccessful ones.
- But some good news, there’s a new journal devoted to just publishing replications in empirical economics.
- Some non-academic jobs:
- For the academic-types, graduate students can once again blog their job market paper on the Development Impact Blog.
- But a good thread for current and future graduate students – a reminder not to pin your sense of self-worth on your academic career. Too much is out of your hands. (h/t Raul Pacheco-Vega)