I wrote this letter to the black goat podcast … will update here if I hear back from them …
Dear goaters (is this a good way to address the three of you?),
I attended SIPS some weeks ago (first timer). I was unsure what to expect but got a lot of bang for my buck (which is great) – as a side note I would recommend first timers to try to go there with a concrete project or question or problem, I think there is a good chance to find people with similar issues interested in collaborations.
This was my first contribution to a Registered Replication Report (RRR). Being one of 40 participating labs was an interesting exercise – it might seem straightforward to run the same study in different labs, but we learned that such small things as ü, ä and ö can generate a huge amount of problems and work (read this if you are into these kind of things). Here is one of the central results: So overall not a lot of action … our lab was actually the one with larges effect size (in the predicted direction).
One of the root causes of where we are (as a science) in psychology and many other disciplines in terms of reproducibility of key (and other) results could not be better summed up than by the man himself Daryl Bem (2002):
“If a datum suggests a new hypothesis, try to find additional evidence for it elsewhere in the data. If you see dim traces of interesting patterns, try to reorganize the data to bring them into bolder relief.
The replication crisis has many interesting effects on how people (and scientists) think about Psychology (and, of course, other fields) … Here is a nice summary of effects that are hard to replicate. Among them ‘classics’ like the power pose or the big brother eyes.
A lot is happening because of these new insights in terms of research (e.g., replication studies) and communication (e.g., Fritz Strack on Facebook).
And then this: Susan Fiske in an upcoming piece in the APS Observer … I am really struggling with this rhetoric – Daniel Lakens to the rescue 🙂
This syllabus of an (obviously) awesome class has a ton of good reads:
Everything is fucked: The syllabus
by Sanjay Srivastava
I would have two additions:
A multi lab replication project on ego-depletion (Hagger & Chatzisarantis, 2016) And the response from Roy Baumeister and Kathleen D. Vohs It’s a really good statement of how f… up things are (in addition to all the other good examples above) …
“A new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die, and a new generation grows up that is familiar with it.