Deepfake Dangers: AI Porn, Censorship, and the "Take It Down Act"

The Personal Impact of Deepfakes

• 💡 Joanne Chew, an actress and visual artist, discovered over 400 pieces of non-consensual deepfake pornography featuring her likeness.
• ⚠️ The content included graphic and disturbing descriptions, causing Chew significant emotional distress and rage.
• 🎯 Despite efforts to report the content and even communicate with the perpetrator, removing the deepfakes proved to be an exhausting and ongoing battle.

Evolution of Deepfake Technology

• 🚀 Deepfake technology has evolved from requiring significant technical skill to being accessible via simple text prompts and apps, making it a mass-market tool.
• 🎬 While Hollywood has used deepfakes for de-aging actors or inserting them into films, this is distinct from the widespread, non-consensual use seen today.
• ⚖️ A unique case involved a deepfake video of a murder victim being used in court as an impact statement, highlighting a complex and ethically ambiguous application of the technology.

Challenges in Combating Deepfakes

• 🔍 Reclaiming one's image after being deepfaked is incredibly difficult, often involving slow platform responses and significant emotional toll on victims.
• 🕵️ Hiring digital investigators can help, but victims often still need to actively participate in finding and reporting the abusive content.
• 🚓 Victims are often hesitant to involve law enforcement due to past negative experiences, lack of evidence, or fear of further victimisation.

The "Take It Down Act" and its Implications

• 🤔 While aiming to penalize the distribution of non-consensual imagery, the "Take It Down Act" is viewed by some as a setup for increased censorship.
• ⏱️ The act's requirement for platforms to remove content within 48 hours, coupled with gutting moderation teams, could lead to hasty removals and potential overreach.
• 🚫 Concerns exist that the law could lead to mass censorship, the removal of adult content altogether, and disproportionately affect smaller platforms unable to comply with its demands.

Broader Concerns and Future Outlook

• 🗣️ The legislation raises free speech issues, with fears that any objectionable content could be removed without fair review, reminiscent of the problematic FOSTA/SESTA laws.
• 📉 There's a concern that the law could be used to target adult content, queer expression, and sexual expression online, aligning with certain political agendas.
• 😟 The adaptability of the adult industry is noted, but the current landscape, influenced by political control and potentially disregarded laws, presents a darker and more uncertain future for online expression and rights.