Wired: Millions of People Are Using Abusive AI ‘Nudify’ Bots on Telegram

Source URL: https://www.wired.com/story/ai-deepfake-nudify-bots-telegram/
Source: Wired
Title: Millions of People Are Using Abusive AI ‘Nudify’ Bots on Telegram

Feedly Summary: Bots that “remove clothes” from images have run rampant on the messaging app, allowing people to create nonconsensual deepfake images even as lawmakers and tech companies try to crack down.

AI Summary and Description: Yes

Summary: The text highlights a disturbing trend in the proliferation of deepfake technology, particularly on Telegram, where bots capable of creating explicit nonconsensual content are easily accessible. This issue underscores the need for enhanced security and privacy measures as well as regulatory frameworks to combat the abuse of generative AI technologies.

Detailed Description: The article discusses the emergence and alarming prevalence of deepfake bots on Telegram, which exploit generative AI to create explicit images and videos, often targeting vulnerable populations, particularly women and minors. Key points include:

– **Historical Context**: In 2020, deepfake expert Henry Ajder identified one of the first Telegram bots that misused AI technology to create explicit content. This marked a significant moment in the conversation around the dangers of deepfakes.

– **Current Landscape**: A recent investigation reveals at least 50 active bots that can easily generate explicit content with minimal user input. These bots have amassed over 4 million monthly users collectively, indicating a significant increase in the accessibility and usage of such harmful technology.

– **User Impact**: The bots heavily target a demographic of young girls and women, contributing to nonconsensual intimate image abuse (NCII), which has escalated since its first appearance in 2017. The use of generative AI advancements has played a pivotal role in this growth.

– **Community Dynamics**: These bots are supported by numerous Telegram channels that distribute updates and promotional content, adding a layer of community and encouragement for misuse.

– **Statistics and Studies**: The text also references a survey indicating that around 40% of US students have encountered deepfake-related issues at their schools within the past year, showcasing the far-reaching impact of this technology.

– **Regulatory Concerns**: The ease of access to such dangerous tools raises serious security and governance concerns. There is an urgent need for improved regulatory controls to mitigate the potential harms posed by deepfake technology.

With the dynamics of AI and deepfake technologies evolving rapidly, security, privacy, and compliance professionals must be aware of the implications for personal safety, and public policy must evolve to address these challenges.