gcdRadar
archive/Patch now/AIR-2020-0034
closedclosed 4 Oct 2020Patch now3 Confirmed exploitationAI

Suicide Clips Evaded TikTok Content Moderation in Coordinated Attack

TikTok automated moderation

Coordinated uploads allowed violating video clips to bypass TikTok's automated moderation systems and reach users. The attack resulted in the exposure of harmful content to the platform's audience.

fix status
Fix status unknown
first report
20 Sep 2020
last update
20 Sep 2020

Timeline · 1

  1. 20 Sep 2020Suicide Clips Evaded TikTok's Automated Moderation in Coordinated Attack

Sources · 1

Research and catalogues

  1. 2020-09-20
    Suicide Clips Evaded TikTok's Automated Moderation in Coordinated Attack
    AI Incident Database · incidentdatabase.ai/cite/366

Titles and links belong to their publishers. The summary above is written by gcdRadar in its own words; data is CC BY-SA 4.0.

Classification

lane
Patch now
AI role
Attack on AI
categories
Adversarial evasion
severity
3 · Confirmed exploitation
fix status
Fix status unknown
targets
Enterprise deployment
owasp llm top 10
no entry for these categories
mitre atlas
AML.T0015 Evade AI ModelAML.T0043 Craft Adversarial Data
tags
content-moderationevasiontiktok
dates
happened 20 Sep 2020 · first reported 20 Sep 2020
origin
AI Incident Database
Derived from the AI Incident Database (CC BY-SA 4.0).
record
confidence 0.80 · created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z

Lane, AI role, categories and severity come from the classifier; the OWASP and ATLAS rows are derived from the categories. How these are assigned

Copy a brief

This record as a short Markdown brief, for a ticket, a chat or a coding agent.

the brief as text
# Suicide Clips Evaded TikTok Content Moderation in Coordinated Attack

https://gcdradar.vercel.app/incidents/suicide-clips-evaded-tiktok-content-moderation-in-coordinate · AIR-2020-0034 · closed 2020-10-04

- Lane: Patch now
- Severity: 3 (Confirmed exploitation)
- Fix status: Fix status unknown
- First reported: 2020-09-20
- AI role: Attack on AI
- Products: TikTok automated moderation

## Summary

Coordinated uploads allowed violating video clips to bypass TikTok's automated moderation systems and reach users. The attack resulted in the exposure of harmful content to the platform's audience.

## What to do

No action recorded; read the sources below and the vendor's advisory.

## Latest updates

- 2020-09-20: Suicide Clips Evaded TikTok's Automated Moderation in Coordinated Attack (https://incidentdatabase.ai/cite/366)

## Sources

- 2020-09-20 AI Incident Database: Suicide Clips Evaded TikTok's Automated Moderation in Coordinated Attack https://incidentdatabase.ai/cite/366

Verify against the vendor's advisory before changing production. Data CC BY-SA 4.0, https://gcdradar.vercel.app.

Related

  1. closed
    DGA detector Botnet DGA Detection Evasion Using Domain Mutation

    Research · since 1 Jan 2020

    AI
  2. closed
    Palo Alto Networks malware detection system Evasion of Deep Learning Detector for Malware C&C Traffic

    Research · since 1 Jan 2020

    AI
  3. closed
    CylancePROTECT Bypassing Cylance AI Malware Detection via Universal String

    Research · since 7 Sep 2019

    AI
  4. closed
    Shanghai government tax office facial recognition Camera Hijack and Facial Recognition Evasion for Tax Fraud

    Patch now · Real loss · since Jan 2020 (approx.)

    AI
  5. closed
    Edge AI Product Microsoft Edge AI Product Evasion Red Team Exercise

    Research · since Feb 2020 (approx.)

    AI
  6. closed
    Azure Microsoft Internal Azure AI Service Red Team Exercise

    Research · since Jan 2020 (approx.)

    AI