Leonardo AI Moderation Bypassed for Nonconsensual Deepfakes

# Leonardo AI Moderation Bypassed for Nonconsensual Deepfakes

https://gcdradar.vercel.app/incidents/leonardo-ai-moderation-bypassed-for-nonconsensual-deepfakes · AIR-2024-0001 · closed 2024-04-09

- Lane: Patch now
- Severity: 3 (Confirmed exploitation)
- Fix status: Fix status unknown
- First reported: 2024-03-26
- AI role: Attack on AI
- Products: Leonardo AI

## Summary

Users exploited Leonardo AI's text-to-image generator by using custom prompts to bypass content moderation systems. The platform was allegedly used to create nonconsensual sexual images of public figures.

## What to do

No action recorded; read the sources below and the vendor's advisory.

## Latest updates

- 2024-03-26: Leonardo AI's Platform Alleged to Have Been Used for Creating Nonconsensual Celebrity Deepfakes (https://incidentdatabase.ai/cite/661)

## Sources

- 2024-03-26 AI Incident Database: Leonardo AI's Platform Alleged to Have Been Used for Creating Nonconsensual Celebrity Deepfakes https://incidentdatabase.ai/cite/661

Verify against the vendor's advisory before changing production. Data CC BY-SA 4.0, https://gcdradar.vercel.app.