Why You Need to be Able to Check Facts
This is the first entry in a new occasional series on how to check facts. In this introduction, I explain why such a series may be useful.
You might wonder why such a series is needed, given the existence of fact-checkers in the media: Don't they make sure that the facts are right before publishing? In addition, there are independent fact-checking groups: Won't they check anything that gets past the news media fact-checkers?
There are two types of institutional fact-checking: pre-publication and post-publication. Pre-publication checking is done by checkers hired by an author or publication before a work is published or broadcast. Post-publication fact-checking is primarily the job of the groups mentioned in the previous paragraph.
- Pre-Publication Fact-Checking: This is not as widespread an activity as you may think. For instance, newspapers usually do not employ designated fact checkers, though reporters and editors sometimes do the job1. Similarly―and more surprisingly, at least to me―most book publishers do not employ checkers2. In fact, most book publishing contracts place the legal burden on the author to ensure that the book is factually correct. So, if a book is fact-checked, it's usually because the author employs a checker. As a result, only the authors of potential best-sellers or those who receive large advances are likely to hire one3.
Pre-pub checking, in the form of one or more individuals labelled "fact checkers" or "researchers", seems to be mostly limited to magazines. One reason for the difference between newspapers and magazines is that there is pressure on newspapers for scoops, whereas magazines are not usually expected to break news. This leaves enough time between the writing of a magazine article and its publication for it to be checked.
Professional fact-checkers do an often thankless job for low pay―at least, in comparison to what the writers make whose work they check. However, their numbers seem to be declining4, as well as the quality of their work, as the periodicals that use them lose readers and advertisers. Even the New Yorker, once celebrated for its rigorous fact-checking5, recently had an egregious factual failure6.
Given the declining state of pre-publication fact-checking, and its absence from most newspapers and traditional book publishers, more of the burden of checking facts is falling upon the post-publication checkers, including you the reader.
- Post-Publication Fact-Checking: Several groups have formed in the last decade or three that engage in fact-checking claims in the news media. Snopes appears to be the oldest of these groups, having begun as a website in 19947, though it was originally limited to debunking urban legends. As pre-publication fact-checking has diminished, the post-publication kind has grown. However, such fact-checking groups usually concentrate on political claims, especially those made by politicians. Such claims are certainly important, but they're not the only ones in need of checking. Moreover, there are so many claims made that there's no way that any one, or even all of these organizations together, can manage to check them all. Ultimately, the reader is the last line of post-publication defense against falsehood.
As an amateur fact-checker, the first step to checking a claim in the media will be to see if any of the post-pub groups has already checked it. However, what if the claim you're interested in hasn't been checked? Then, what do you do? This series will try to answer this question.
Assuming that I've now convinced you that learning to check facts for yourself is a valuable intellectual self-defense skill, you might think of getting ahold of one or both of the fact-checking books I've already cited in the notes, below. I don't mean to discourage you from doing so, but both were written by professional fact-checkers for fellow professionals, rather than for us amateurs. While there are some useful pointers in them, they are disappointingly unhelpful for the amateur, which is why some guidance specifically aimed at non-professionals may be useful.
I am not, nor have I ever been, a professional fact-checker, but this series is not intended for the pros, though perhaps even they could benefit from it. Rather, it is by an amateur, for amateurs. Amateur fact-checking differs from the professional kind in four main ways:
- Trivia: The professionals are often concerned with minutiae, such as exactly how people's names are spelled, and a great deal of their time and effort is devoted to phoning people to check such things. This is because one sure way to make people angry is to misspell their names, and the only sure way to check the spelling is to ask them. As an amateur, there is no reason to be concerned with such trivia, and checking facts will seldom involve using the phone. The facts we amateurs need to check are the important ones.
- Libel: An important concern of fact-checkers who work for authors or periodicals is the possibility of libel. As a result, the pros need to check claims that may be libelous, and one fact-checking guide has a whole chapter on libel law8. As an amateur, you're neither the author nor publisher of the claims you are checking, so you needn't worry about whether they are libelous. What you want to know is are they true.
- Plagiarism: Another worry for the professional but not the amateur is the possibility of plagiarism. There have been several prominent scandals in the past few decades involving plagiarism, and publishers are therefore worried about it. As a consequence, works for the professional will discuss plagiarism, what it is and how to detect it9. However, who made a claim first is really not the amateur's concern, but whether it is true or false.
- Tact: An important aspect of professional fact-checking is getting along with the authors and editors one has to deal with, and this may involve a lot of negotiation10. Thankfully, we amateurs don't need to worry so much about stepping on people's toes, except perhaps if you want to get an author or publication to correct or retract an article.
For the above reasons, publications aimed at professional fact-checkers are usually of limited value for the amateur, hence this proposed series of entries. Questions that future entries will attempt to answer include the following: Just what is a fact? What's the difference between a fact and an opinion? What's the difference between a fact and a value? Which facts are checkable and which are not? How can you tell when a supposed "fact" needs checking? Why should you develop your own plausibility detector, and how do you do it?
Fact-checking is too important a task to leave to the professionals.
- Sarah Harrison Smith, The Fact Checker's Bible: A Guide to Getting it Right (2004), pp. 29-32; hereinafter "Smith".
- Brooke Borel, The Chicago Guide to Fact-Checking (2016), p. 6; hereinafter "Borel".
- Emma Copley Eisenberg, "Fact Checking Is the Core of Nonfiction Writing. Why Do So Many Publishers Refuse to Do It?", Esquire, 8/26/2020.
- Stephanie Fairyington, "In the era of fake news, where have all the fact-checkers gone?", Columbia Journalism Review, 2/23/2018.
- Sarah Harrison Smith, author of The Fact Checker's Bible, was a fact-checker at The New Yorker; see Smith, p. i.
- Who Will Fact-Check the Fact-Checkers?, 7/30/2020
- "Snopes is the internet's definitive fact-checking resource.", Snopes, accessed: 9/8/2020.
- Smith, chapter 6.
- Smith, pp. 87-95 & Borel, pp. 88-89.
- Smith has an entire chapter on this: chapter 3; but Borel has only a short section: pp. 57-58.
Prussian Roulette, Game 2*
If you survive a game of Prussian roulette consisting of two rounds, those wily Prussians will suggest that you play a second game, also consisting of two rounds. However, this time, the two bullets will be inserted into non-adjacent chambers in the revolver.
Your chance of surviving the first round of this game is unchanged from the previous one. Just as in the first game, if you survive the first round you'll be offered the choice of spinning or not spinning the cylinder for the second round. Should you accept a spin in this game, should you decline a spin, or doesn't it matter?
Extra Credit: What are your chances of surviving a game of this version of Prussian roulette if you choose to spin the cylinder on the second round, and if you choose not to spin it?
You should accept a second spin. Since the two bullets in the cylinder are no longer in adjacent chambers, there's at least one empty chamber between them. This means that of the four empty chambers in the cylinder two of them are followed immediately by a chamber with a bullet in it, instead of only one in the first game. This means that the chance that the chamber following the empty one selected in the first round contains a bullet is two out of four, or one-half. So, your odds of surviving the second round are only one in two if you don't spin, but two in three if you do. Thus, you should choose to spin.
Extra Credit Solution: As we saw in the previous puzzle, your chance of surviving both rounds of the game if you spin both times is two-thirds squared, which equals four out of nine times, or about 44%.
As we have seen in the Solution, above, if you refrain from spinning the cylinder, your chance of surviving the second round decreases to two out of four, or one-half. So, your chance of surviving both rounds is one-half of two-thirds, that is, one-third. This is an even worse chance of survival than if you spin.