The Rising Threat of AI Bots Used to Create Deepfakes on Telegram

The increasing use of AI technology to generate deepfakes has become a serious concern, particularly when it comes to creating non-consensual intimate images (NCIIs) of women and girls. A recent report reveals that more than 50 AI bots on Telegram are being used for this very purpose, and they have attracted over 4 million monthly users. These bots, sometimes referred to as “undress AI,” are capable of generating explicit images within a few clicks, posing a significant threat to privacy and mental well-being.

Despite efforts to remove these bots after media coverage, new ones quickly emerge, reflecting the challenge of regulating such technology. Many of these bots allow users to upload photos and create deepfakes that strip clothes or depict sexual acts, all without the consent of the individuals in the images. The accessibility and ease of use make it easier for perpetrators to exploit women, leading to cases of sextortion and other forms of harassment.

Source

Experts like Henry Ajder, a deepfake researcher, have labeled the situation “nightmarish,” emphasizing the particular vulnerability of women and girls to these AI tools. Ajder discovered similar bots in 2020, and since then, their presence and user base have grown alarmingly. Recent surveys show that many students in the U.S. have been exposed to deepfakes, increasing concerns about the misuse of AI technology.

The psychological toll on victims is severe. Many experience humiliation, fear, and shame, which can deeply impact their mental health. Emma Pickering from Refuge, a UK-based domestic abuse organization, explains that victims often feel powerless, and the lack of legal consequences for perpetrators only adds to their distress. In some countries, like the United States, legislation such as the Deepfake Accountability Act has been introduced to tackle the issue, but progress remains slow and insufficient.

Telegram’s response has been criticized as inadequate, as the deletion of some bots has not stopped new ones from being created. This highlights the urgent need for stronger regulations, greater accountability, and the development of more effective tools to control the misuse of AI technology.

While there is ongoing debate on how best to regulate the creation and distribution of deepfakes, the growing number of users on these platforms signals the need for swift action. With technology advancing rapidly, addressing this issue will require coordinated efforts from governments, tech companies, and advocacy groups.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top