Survivorship Bias

Survivorship Bias is a common error of thinking where we arrive at false conclusions by only examining success cases.

For example, on one of my former teams, some of us had been keeping tabs on how well Microservices had worked at NetFlix and we didn't want to miss out. We made a collective decision to start a new project following a strict Microservice architecture.

However, we failed to take into account the stories of where Microservices hadn't worked out, discovering for ourselves how much unnecessary complexity they introduce for a small team. This was so common in tech that Thoughtworks named it Microservice Envy in their 2015 Radar.

Every page about Survivorship Bias has to include the story of Abraham Wald. During WW2, he and his team were instructed to recommend which parts of fighter planes they should reinforce based on an assessment of the damage they took during battle. At odds with recomendations from the US military, he recommended that they reinforce the parts of the plane that took no damage. The planes that had been hit in those areas never made it back.

Another error of thinking like Confirmation Bias.

Ahrens (2017) (pg. 136)

References

Sönke Ahrens. How to Take Smart Notes: One Simple Technique to Boost Writing, Learning and Thinking: For Students, Academics and Nonfiction Book Writers. CreateSpace, North Charleston, SC, 2017. ISBN 978-1-5428-6650-7.


Backlinks