Misinformation Spreads Online: AI, Fact-Checking, and Social Media

The Rapid Spread of Misinformation

• ⚡ Misinformation spread instantly on social media following the murders in Minneapolis, even as investigators were still working.
• 🎯 Political influencers quickly claimed motives, such as a lawmaker voting against party politics, without verified information.

Tactics Used to Spread Disinformation

• 🔄 Old footage, including from the George Floyd protests and even a war game (Arma 3), was re-used and presented as current events.
• 💰 Accusations of protesters being paid, amplified by figures like Donald Trump, were common.
• 🤖 AI-generated videos, like one featuring a purported National Guard member, were spread, often with subtle visual cues of being fake that viewers overlooked.

Social Media Incentives and Platform Roles

• 📈 Social media platforms incentivize viral content, which can lead to the monetization of false and misleading stories during chaotic events.
• 🗣️ The desire to be the first to share information, regardless of accuracy, fuels the rapid spread.
• ⚠️ Platforms are aware that users capitalize on chaos, but their incentives are designed for sharing breaking news, which can be exploited by bad actors.

Challenges with Verifying Information

• 🔍 Verifiable and accurate information is becoming increasingly difficult to find online.
• 🖼️ Videos, such as one showing officers separating a baby from a mother, are pushed out with false narratives (e.g., an ICE raid), and it can take significant time to debunk them.
• 📉 Major platforms are rolling back fact-checking, leading people to rely on AI chatbots for verification.

AI Chatbots and Disinformation

• 💬 AI chatbots like X's Grok and ChatGPT are being asked to verify information but are often returning disinformation instead of accurate facts.
• 📍 An example cited involved Grok incorrectly identifying the origin of images posted by Governor Gavin Newsom, mistaking them for the US troop withdrawal from Afghanistan.
• ⚠️ The reliance on AI chatbots for fact-checking is a worrying escalation, especially as human fact-checkers are removed from platforms.

The Future of Reality and Consensus

• 🔮 The ability to create plausible unreality is improving with AI, while trust in each other and in institutions continues to decline.
• 🧩 This divergence makes it increasingly impossible to come to a consensus about basic reality, leading to fractured realities.