The Daily Mail Snopes Story And Fact Checking The Fact Checkers
https://www.forbes.com/sites/kalevl...fact-checking-the-fact-checkers/#2ab69df5227f
Yesterday afternoon a colleague forwarded me an
article from the Daily Mail, asking me if it could possibly be true. The article in question is an expose on
Snopes.com, the fact checking site used by journalists and citizens across the world and one of the sites that Facebook recently partnered with to fact check news stories on its platform. The Daily Mail’s article makes a number of claims about the site’s principles and organization, drawing heavily from the proceedings of a contentious divorce between the site’s founders and questioning whether the site could possibly act as a trusted and neutral arbitrator of the “truth.”
When I first read through the Daily Mail article I immediately suspected the story itself must certainly be “fake news” because of how devastating the claims were and that given that Snopes.com was so heavily used by the journalistic community, if any of the claims were true, someone would have already written about them and companies like Facebook would not be partnering with them. I also noted that despite having been online for several hours, no other major mainstream news outlet had written about the story, which is typically a strong sign of a false or misleading story. Yet at the same time, the Daily Mail appeared to be sourcing its claims from a series of emails and other documents from a court case, some of which it reproduced in its article and, perhaps most strangely, neither Snopes nor its principles had issued any kind of statement through its website or social media channels disclaiming the story.
On the surface this looked like a classic case of fake news – a scandalous and highly shareable story, incorporating official-looking materials and sourcing, yet with no other mainstream outlet even mentioning the story. I myself told my colleague I simply did not know what to think. Was this a complete fabrication by a disgruntled target of Snopes or was this really an explosive expose pulling back the curtain on one of the world’s most respected and famous fact checking brands?
In fact, one of my first thoughts upon reading the article is that this is precisely how the “fake news” community would fight back against fact checking – by running a drip-drip of fake or misleading explosive stories to discredit and cast doubt upon the fact checkers.
In the counter-intelligence world, this is what is known as a “wilderness of mirrors” – creating a chaotic information environment that so perfectly blends truth, half-truth and fiction that even the best can no longer tell what’s real and what’s not.
Thus, when I reached out to David Mikkelson, the founder of Snopes, for comment, I fully expected him to respond with a lengthy email in Snopes’ trademark point-by-point format, fully refuting each and every one of the claims in the Daily Mail’s article and writing the entire article off as “fake news.”
It was with incredible surprise therefore that I received David’s one-sentence response which read in its entirety “I'd be happy to speak with you, but I can only address some aspects in general because I'm precluded by the terms of a binding settlement agreement from discussing details of my divorce.”
This absolutely astounded me. Here was the one of the world’s most respected fact checking organizations, soon to be an ultimate arbitrator of “truth” on Facebook, saying that it cannot respond to a fact checking request because of a secrecy agreement.
In short, when someone attempted to fact check the fact checker, the response was the equivalent of “it's secret.”
It is impossible to understate how antithetical this is to the fact checking world, in which absolute openness and transparency are necessary prerequisites for trust. How can fact checking organizations like Snopes expect the public to place trust in them if when they themselves are called into question, their response is that they can’t respond.
When I presented a set of subsequent clarifying questions to David, he provided responses to some and not to others. Of particular interest, when pressed about claims by the Daily Mail that at least one Snopes employee has actually run for political office and that this presents at the very least the appearance of potential bias in Snopes’ fact checks, David responded “It's pretty much a given that anyone who has ever run for (or held) a political office did so under some form of party affiliation and said something critical about their opponent(s) and/or other politicians at some point. Does that mean anyone who has ever run for office is manifestly unsuited to be associated with a fact-checking endeavor, in any capacity?”
That is actually a fascinating response to come from a fact checking organization that prides itself on its claimed neutrality. Think about it this way – what if there was a fact checking organization whose fact checkers were all drawn from the ranks of Breitbart and Infowars? Most liberals would likely dismiss such an organization as partisan and biased. Similarly, an organization whose fact checkers were all drawn from Occupy Democrats and Huffington Post might be dismissed by conservatives as partisan and biased. In fact, when I asked several colleagues for their thoughts on this issue this morning, the unanimous response back was that people with strong self-declared political leanings on either side should not be a part of a fact checking organization and all had incorrectly assumed that Snopes would have felt the same way and had a blanket policy against placing partisan individuals as fact checkers.
In fact, this is one of the reasons that fact checking organizations must be transparent and open. If an organization like Snopes feels it is ok to hire partisan employees who have run for public office on behalf of a particular political party and employ them as fact checkers where they have a high likelihood of being asked to weigh in on material aligned with or contrary to their views, how can they reasonably be expected to act as neutral arbitrators of the truth?
Put another way, some Republicans believe firmly that climate change is a falsehood and that humans are not responsible in any way for climatic change. Those in the scientific community might object to an anti-climate change Republican serving as a fact checker for climate change stories at Snopes and flagging every article about a new scientific study on climate change as fake news. Yet, we have no way of knowing the biases of the fact checkers at Snopes – we simply have to trust that the site’s views on what constitutes neutrality are the same as ours.
When I asked for comment on the specific detailed criteria Snopes uses to screen its applicants and decide who to hire as a fact checker, surprisingly David demurred, saying only that the site looks for applicants across all fields and skills. He specifically did not provide any detail of any kind regarding the screening process and how Snopes evaluates potential hires. David also did not respond to further emails asking whether, as part of the screening process, Snopes has applicants fact check a set of articles to evaluate their reasoning and research skills and to gain insight into their thinking process.
This was highly unexpected, as I had assumed that a fact checking site as reputable as Snopes would have a detailed written formal evaluation process for new fact checkers that would include having them perform a set of fact checks and include a lengthy set of interview questions designed to assess their ability to identify potential or perceived conflicts of interest and work through potential biases.
Kalev Leetaru , Contributor
I write about the broad intersection of data and society. Opinions expressed by Forbes Contributors are their own.