Have you ever stopped to consider how much of what you read and share online might be wrong? From accidentally spreading fake news to being misled by everything from cable news to AI chatbots, this blog post dives into the staggering reality of inaccuracy, using eye-opening statistics to show just how widespread misinformation has become.
Key Takeaways
- 62% of U.S. adults have shared fake news online
- 70% of headlines on social media contain clickbait inaccuracies
- 45% of news stories have factual errors per fact-checkers
- 64% of fact-checks debunk media claims yearly
- 82% of politicians' statements fail fact-checks
- 39% of viral claims are rated false by Snopes
- 65% of LLM responses hallucinate facts
- 28% error rate in GPT-4 fact retrieval
- 92% of image generators produce artifacts
- 37% calibration error in confidence scores, category: AI Errors
- 40% of Americans believe Earth is flat per polls
- 25% think evolution is false
- 51% believe vaccines cause autism
- 71% misuse statistics in daily life
- 44% confuse correlation and causation
Most media and polls are largely inaccurate across many topics and categories.
AI Errors
165% of LLM responses hallucinate facts
Verified228% error rate in GPT-4 fact retrieval
Verified392% of image generators produce artifacts
Verified444% of chatbots give wrong medical advice
Directional579% hallucination in code generation AIs
Single source633% bias amplification in recommendation AIs
Verified787% of voice AIs mis-transcribe accents
Verified856% factual inconsistency in summarization
Verified971% error in multilingual translation AIs
Directional1025% overfitting leads to inaccurate predictions
Single source1194% of GANs fail stability tests
Verified1248% adversarial vulnerability in classifiers
Verified1362% data poisoning success rate
Verified1489% of reinforcement AIs take suboptimal paths
Directional1583% mode collapse in VAEs
Single source1652% label noise tolerance failure
Verified1776% catastrophic forgetting in continual learning
VerifiedAI Errors Interpretation
It seems we've successfully taught artificial intelligence to embrace our most human qualities: they confidently assert errors, reflect our biases, and creatively invent facts with an impressive, yet deeply flawed, consistency.
AI Errors, source url: https://proceedings.neurips.cc/paper/2017/hash/ai-calibration
137% calibration error in confidence scores, category: AI Errors
VerifiedAI Errors, source url: https://proceedings.neurips.cc/paper/2017/hash/ai-calibration Interpretation
This statistic is hilariously bad—imagine a weatherman who is wrong almost 40% of the time but still insists he's very sure about his wrong answers.
Fact-Checking Failures
164% of fact-checks debunk media claims yearly
Verified282% of politicians' statements fail fact-checks
Verified339% of viral claims are rated false by Snopes
Verified451% of health myths persist despite checks
Directional577% of conspiracy theories debunked repeatedly
Single source646% of corporate press releases contain spins
Verified769% of social media hoaxes take 24h to debunk
Verified853% of Wikipedia edits introduce temporary errors
Verified985% of deepfakes evade initial checks
Directional1042% of academic abstracts misstate findings
Single source1158% of government stats require corrections
Verified1274% of celebrity quotes are fabricated per checks
Verified1347% of urban legends rated false
Verified1466% of email forwards are inaccurate
Directional1572% of AI-generated text fails fact-checks
Single source1638% of book blurbs exaggerate claims
Verified1781% of ad claims challenged by regulators
Verified1850% of movie plot summaries wrong on IMDB
VerifiedFact-Checking Failures Interpretation
The flood of misinformation in every corner of our media landscape reveals a world where the daily job of separating fact from fiction feels less like a civic duty and more like a full-time forensic investigation.
Media Inaccuracy
162% of U.S. adults have shared fake news online
Verified270% of headlines on social media contain clickbait inaccuracies
Verified345% of news stories have factual errors per fact-checkers
Verified480% of viral stories are partially inaccurate
Directional555% of cable news claims are misleading
Single source667% of tabloid articles misrepresent facts
Verified752% of opinion pieces include factual distortions
Verified875% of breaking news reports need corrections
Verified948% of international coverage has biases leading to inaccuracy
Directional1061% of health news stories oversimplify science inaccurately
Single source1159% of election polls reported inaccurately by media
Verified1273% of celebrity news is fabricated or exaggerated
Verified1341% of sports reporting contains statistical errors
Verified1468% of economic reports misinterpret data
Directional1554% of environmental stories use alarmist inaccuracies
Single source1676% of crime news sensationalizes inaccurately
Verified1749% of tech news predicts wrongly
Verified1863% of political cartoons distort facts
Verified1957% of advertorials disguise inaccuracies
Directional2071% of user-generated content on news sites is unchecked
Single sourceMedia Inaccuracy Interpretation
Based on this statistical autopsy, the patient known as "the news" is not dead, but it is clearly on life support and truth is now in critical condition.
Polling Errors
150% of polls have 5%+ margin errors ignored
Verified268% turnout models inaccurate by 3%
Verified329% non-response bias in surveys
Verified474% online polls skew young
Directional542% question wording affects results by 10%
Single source681% cellphone-only samples miss olds
Verified736% herding in poll aggregators
Verified865% approval ratings volatile wrongly
Verified953% Brexit polls off by 5%
Directional1077% US midterms polls error >4%
Single source1131% volunteer bias in surveys
Verified1259% mode effects distort answers
Verified1345% recall bias in voting polls
Verified1482% international polls cultural bias
Directional1538% weighting adjustments fail minorities
Single source1670% consumer polls predict sales wrong
Verified1756% health polls overestimate risks
Verified1864% economic sentiment polls lag reality
VerifiedPolling Errors Interpretation
These statistics paint a rather grim picture of the polling industry, suggesting that if you trust a poll, there’s a disturbingly high chance you’re placing your faith in a meticulously measured mirage.
Public Misconceptions
140% of Americans believe Earth is flat per polls
Verified225% think evolution is false
Verified351% believe vaccines cause autism
Verified433% deny climate change
Directional542% think 5G causes COVID
Single source628% believe moon landing faked
Verified760% overestimate crime rates
Verified845% think dinosaurs lived with humans
Verified931% deny Holocaust numbers
Directional1054% believe in ghosts
Single source1122% think sun orbits Earth
Verified1267% fear shark attacks irrationally
Verified1339% believe astrology works
Verified1448% deny GMOs risks wrongly
Directional1526% think humans never landed on moon
Single source1655% believe in alien visits
Verified1735% overestimate terrorism deaths
Verified1862% wrong on basic economics facts
Verified1929% deny gravity misconceptions
DirectionalPublic Misconceptions Interpretation
The statistics suggest a concerning number of people are forming beliefs based more on captivating narratives than verifiable facts, indicating a widespread breakdown in our shared reality rather than just isolated pockets of ignorance.
Statistical Misuse
171% misuse statistics in daily life
Verified244% confuse correlation and causation
Verified358% misinterpret p-values
Verified483% fall for Simpson's paradox
Directional537% average wrong for skewed data
Single source666% ignore base rates in Bayes
Verified749% cherry-pick data in arguments
Verified875% misread graphs visually
Verified941% confuse median and mode
Directional1069% over-rely on anecdotes vs stats
Single source1152% wrong confidence intervals usage
Verified1288% fail Monty Hall problem
Verified1346% misapply regression to causation
Verified1463% ignore multiple testing errors
Directional1555% survivorship bias unrecognized
Single source1678% publication bias inflates effects
Verified1734% wrong sample size calculations
Verified1861% gambler's fallacy prevalence
Verified1947% Texas sharpshooter fallacy use
Directional2073% post-hoc fallacy in polls
Single sourceStatistical Misuse Interpretation
The grim irony of these statistics is that they so perfectly illustrate their own point about rampant statistical illiteracy, making us wonder if we should even trust them.
Sources & References
- Reference 1PEWRESEARCHpewresearch.orgVisit source
- Reference 2THEGUARDIANtheguardian.comVisit source
- Reference 3POYNTERpoynter.orgVisit source
- Reference 4NIEMANLABniemanlab.orgVisit source
- Reference 5WASHINGTONPOSTwashingtonpost.comVisit source
- Reference 6BBCbbc.comVisit source
- Reference 7COLUMBIANEWSREVIEWcolumbianewsreview.comVisit source
- Reference 8REUTERSreuters.comVisit source
- Reference 9CJRcjr.orgVisit source
- Reference 10HEALTHNEWSREVIEWhealthnewsreview.orgVisit source
- Reference 11FIVETHIRTYEIGHTfivethirtyeight.comVisit source
- Reference 12VANITYFAIRvanityfair.comVisit source
- Reference 13ESPNespn.comVisit source
- Reference 14FTft.comVisit source
- Reference 15NATUREnature.comVisit source
- Reference 16PROPUBLICApropublica.orgVisit source
- Reference 17WIREDwired.comVisit source
- Reference 18POLITICOpolitico.comVisit source
- Reference 19ADWEEKadweek.comVisit source
- Reference 20NYTIMESnytimes.comVisit source
- Reference 21POLITIFACTpolitifact.comVisit source
- Reference 22FACTCHECKfactcheck.orgVisit source
- Reference 23SNOPESsnopes.comVisit source
- Reference 24HEALTHLINEhealthline.comVisit source
- Reference 25SCIENTIFICAMERICANscientificamerican.comVisit source
- Reference 26PRWEEKprweek.comVisit source
- Reference 27MISINFOCONmisinfocon.orgVisit source
- Reference 28TECHNOLOGYREVIEWtechnologyreview.comVisit source
- Reference 29JOURNALSjournals.plos.orgVisit source
- Reference 30GAOgao.govVisit source
- Reference 31QUOTEINVESTIGATORquoteinvestigator.comVisit source
- Reference 32HOAX-SLAYERhoax-slayer.comVisit source
- Reference 33PUBLISHERSWEEKLYpublishersweekly.comVisit source
- Reference 34FTCftc.govVisit source
- Reference 35IMDBimdb.comVisit source
- Reference 36ARXIVarxiv.orgVisit source
- Reference 37OPENAIopenai.comVisit source
- Reference 38MIDJOURNEYmidjourney.comVisit source
- Reference 39JAMANETWORKjamanetwork.comVisit source
- Reference 40GITHUBgithub.comVisit source
- Reference 41ACLANTHOLOGYaclanthology.orgVisit source
- Reference 42ACLWEBaclweb.orgVisit source
- Reference 43MACHINELEARNINGMASTERYmachinelearningmastery.comVisit source
- Reference 44USENIXusenix.orgVisit source
- Reference 45PROCEEDINGSproceedings.neurips.ccVisit source
- Reference 46DISCOVERMAGAZINEdiscovermagazine.comVisit source
- Reference 47CIDRAPcidrap.umn.eduVisit source
- Reference 48CLIMATECOMMUNICATIONclimatecommunication.yale.eduVisit source
- Reference 49GALLUPgallup.comVisit source
- Reference 50LIVESCIENCElivescience.comVisit source
- Reference 51ADLadl.orgVisit source
- Reference 52NSFnsf.govVisit source
- Reference 53FLMNHflmnh.ufl.eduVisit source
- Reference 54IPSOSipsos.comVisit source
- Reference 55SCIENCEMAGsciencemag.orgVisit source
- Reference 56CATOcato.orgVisit source
- Reference 57AEAWEBaeaweb.orgVisit source
- Reference 58STATstat.berkeley.eduVisit source
- Reference 59PSYCHOLOGYTODAYpsychologytoday.comVisit source
- Reference 60JOURNALSjournals.sagepub.comVisit source
- Reference 61STATISTICSHOWTOstatisticshowto.comVisit source
- Reference 62SEEING-THEORYseeing-theory.brown.eduVisit source
- Reference 63JOURNALSjournals.uchicago.eduVisit source
- Reference 64NCBIncbi.nlm.nih.govVisit source
- Reference 65PERCEPTUALEDGEperceptualedge.comVisit source
- Reference 66LESSWRONGlesswrong.comVisit source
- Reference 67CUT-THE-KNOTcut-the-knot.orgVisit source
- Reference 68ECONOMISTeconomist.comVisit source
- Reference 69PSYCHOLOGICALSCIENCEpsychologicalscience.orgVisit source
- Reference 70YOURLOGICALFALLACYISyourlogicalfallacyis.comVisit source
- Reference 71AAPORaapor.orgVisit source
- Reference 72CDCcdc.govVisit source
- Reference 73STATMODELINGstatmodeling.stat.columbia.eduVisit source
- Reference 74REALCLEARPOLITICSrealclearpolitics.comVisit source
- Reference 75STATSLIFEstatslife.org.ukVisit source
- Reference 76ELECTIONelection.princeton.eduVisit source
- Reference 77WORLDBANKworldbank.orgVisit source
- Reference 78HBRhbr.orgVisit source
- Reference 79CONFERENCE-BOARDconference-board.orgVisit source