Skip to content

Why research beats anecdote in our search for knowledge

September 22, 2014

By Tim Dean

Originally published on

UNDERSTANDING RESEARCH: What do we actually mean by research and how does it help inform our understanding of things? We begin today by looking at the origins of research.

It is comforting to feel like we understand the world around us and reassuring to have an explanation for everything. But where does our understanding come from and how reliable is it?

Certainty is seductive, so we tend to cling to it. We hunt for evidence that buttresses it, while ignoring or rejecting evidence that threatens to undermine it.

How does it all work?
Flickr/Helga Weber, CC BY-NC-ND

We seek out friends and media commentators who share our certainty, and then reinforce that certainty in their company. We use certainty as a bulwark in our conversations with others and we use it to thump tables when we bump up against someone else’s convictions.

But deep down we all know that the universe is a bafflingly complex place, and that most things that happen will surprise us and challenge our understanding of how things really are.

In quiet moments, we might even acknowledge that much of our certainty rests on flimsy foundations of perceived wisdom, common sense and intuition, anecdote and wishful thinking.

How do we know?

Consider disease. For the majority of human history most people were certain that disease was caused by the machinations of malevolent spirits. Or they were sure it was cast upon us by witches and warlocks.

Or they were convinced that victims brought it upon themselves by their own wicked ways (irrespective of the easily overlooked fact that a mere babe dying of smallpox was incapable of malice).

More recently, many people were certain that disease was caused by “miasma” such as the fetid fog that wafted off the sewerage-laden Thames in 19th century London, UK.

Was it the fog on Thames that caused disease in old London – or something else?
Flickr/tim_d, CC BY-NC-SA

After all, those who lived in whiffing distance of the Thames were the ones most likely to be struck down by cholera (irrespective of the easily ignored detail that the disease could spread even without the miasma’s help).

These false notions of disease were, in a sense, intuitive. They fit with our common sense understanding of how the world works: if A happens before B, then A is the cause of B.

Yet no amount of certainty prevented these theories of disease from being utterly wrong, thus crippling our ability to treat them. As it happens, most diseases are caused by microscopic pathogens which are, by their very nature, invisible to our naked eye observations. As such, they were beyond the ken of common sense.

It took rigorous scrutiny of the available facts, acknowledgement of subtle inconsistencies and irregularities in the prevailing theories, as well as careful experimentation and detailed observation in order to reveal the true cause of disease.

Rise of the researcher

It also took a few brave people to embrace uncertainty. It took them to admit their ignorance and decide to follow the facts wherever they took them, even if that path was long and arduous, and raised more questions than it answered.

It took more than common sense and intuition, anecdote and wishful thinking to discover germs and transform medicine. It took genuine research to reveal the facts.

Research is the key to being a scientist.
Flickr/Jabiz Raisdana, CC BY-NC

The results speak for themselves: life expectancy at birth before germ theory was under 40, with between 10%-30% of infants never making it to adulthood.

Only half of those who reached the age of 20 went on to survive to 60. The primary killer was infections. Today in those countries that have embraced germ theory and modern medicine, it is closer to 80.

Research itself can be defined in many ways, but at its core it’s ultimately about rigour. Genuine research – whether in the sciences or the humanities – does not rely on intuition or common sense. It doesn’t lean on anecdote or conjecture. It doesn’t seek to reinforce pre-existing beliefs or ratify wishful thinking.

Genuine research acknowledges that reality is not transparent to human perception and that we have to work hard to uncover the facts. It uses uncertainty as a guidepost to knowledge rather than a stop sign for further enquiry.

Genuine researchers are those rare individuals who have come to terms with their uncertainty and confront it on a daily basis. They have embraced rigour in their methods of enquiry and value truth over comfort. Their hard work over the past couple of centuries has lifted us out of the fog of ignorance and into the world of knowledge and prosperity we inhabit today.

Then come the doubters

Yet, somehow, our appreciation for the power of rigorous research has diminished in recent years.

It is ironic that the world we live in today is built on a solid foundation of rigour in a number of fields such as science, medicine, economics, political science and many others. Yet that same world makes it easier than ever for non-experts to spread their intuitive falsehoods under the pretext of common sense.

We’ve probably all come across the various online ads saying some new easy health tip or other – such as easy teeth whitening – that was “discovered by a mom”, or seen Hollywood actors called upon as experts in fields other than acting. Jenny McCarthy might be photogenic, but her comments about vaccines are as dangerous as they are uninformed.

Anecdote often passes as evidence, and post-hoc explanations often pass as theories. Intuitive explanations spread throughout the internet, made appealing by their simplicity rather than their veracity.

Why research matters

Research, and researchers, deserve better than that.

If we value fact over falsehood then we should constantly remind ourselves of the dangers of certainty and the poverty of intuition. We should remind ourselves that our belief in something should be held with a conviction proportional only to the evidence we have in support of it.

And if we haven’t undertaken the rigours of research ourselves to uncover that evidence, then we should place greater credence on the words of those who have.

Certainty is seductive, wishful thinking is alluring and anecdote can be compelling. But they are also symptoms of a disease for which rigorous research is the only cure.

The Conversation

Tim Dean does not work for, consult to, own shares in or receive funding from any company or organisation that would benefit from this article, and has no relevant affiliations.

This article was originally published on The Conversation.
Read the original article.

  1. Chelsea D permalink

    I was eager to see what this site would say on the topic of vaccines. I’m disappointed with the result. There is more than just anecdotes to rely on with the claim that vaccines cause Autism. Here is a collection of 30 studies that show a possible link between vaccines and Autism. sand there are many many more. I’m assuming who ever wrote this article knows that there are only 14 studies that claim there is no link between Autism and vaccines. Of those 14 studies they have only looked at ONE ingredient and ONE vaccine. So out of simply curiosity, what was the explanation behind doubting Jenny Mccarthy? Especially looking at the lack of placebo testing with vaccines that are currently on the schedule, as well as the lack of necessary studies such as vaccinated vs. unvaccinated, testing of the vaccine schedule as a whole, and the lack of long-term double blind truly placebo controlled studies. I would appreciate a reply, thank you.

Be part of ScienceOrNot? Write a comment, make a suggestion or add an example!

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: