Description: Seven channels were connected in a Telegram ecosystem centered around letting subscribers, as a paid service, generate non-consensual deepfake nudes using a bot from submitted photos of women, including underage girls and women who they know in real life.
Entities
View all entitiesAlleged: Telegram channels and Alberto developed an AI system deployed by Telegram channels, which harmed Women , underage girls and female celebrities.
Incident Stats
Incident ID
530
Report Count
2
Incident Date
2019-07-11
Editors
Khoa Lam, Daniel Atherton
Applied Taxonomies
Risk Subdomain
A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
4.3. Fraud, scams, and targeted manipulation
Risk Domain
The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
- Malicious Actors & Misuse
Entity
Which, if any, entity is presented as the main cause of the risk
Human
Timing
The stage in the AI lifecycle at which the risk is presented as occurring
Post-deployment
Intent
Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
Intentional
Incident Reports
Reports Timeline
/cdn.vox-cdn.com/uploads/chorus_asset/file/13959620/acastro_190204_1777_privacy_0001.jpg)
/cdn.vox-cdn.com/uploads/chorus_asset/file/13959620/acastro_190204_1777_privacy_0001.jpg)
Researchers have discovered a “deepfake ecosystem” on the messaging app Telegram centered around bots that generate fake nudes on request. Users interacting with these bots say they’re mainly creating nudes of women they know using images t…
Within 24 hours, the Vice article had inspired such a backlash that the creators of the app quickly took it down. The DeepNude Twitter account announced that no other versions would be released, and no one else would get access to the techn…
Variants
A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
unreviewed
Incident Date:
2023-08-03
Description of Incident Circumstances
Journalistic reporting on the circumstances of the incident to help inform people what happened, where, involving who, when, and why.
Researchers have discovered a “deepfake ecosystem” on the messaging app Telegram centered around bots that generate fake nudes on
Inputs / Outputs
The sequence of data inputs into the intelligent system and outputs produced by the system involved in the incident. For a chatbot, this will generally present a back and forth between a human and the chatbot's responses.
Raji
12345
Sekar
