Microsoft Tay chatbot manipulated to produce offensive tweets

# Microsoft Tay chatbot manipulated to produce offensive tweets

https://gcdradar.vercel.app/incidents/microsoft-tay-chatbot-manipulated-to-produce-offensive-tweet · AIR-2022-0034 · closed 2023-01-06

- Lane: Patch now
- Severity: 3 (Confirmed exploitation)
- Fix status: Fix status unknown
- First reported: 2022-12-23 (happened 2016-03-24)
- AI role: Attack on AI
- Products: Tay

## Summary

Microsoft's Tay chatbot was manipulated into posting racist and offensive tweets in 2016. The bot was taken offline within twenty-four hours of its release.

## What to do

No action recorded; read the sources below and the vendor's advisory.

## Latest updates

- 2022-12-23: Tay Poisoning (https://atlas.mitre.org/studies/AML.CS0009)
- 2022-12-23: Incident 6: TayBot (https://incidentdatabase.ai/cite/6)
- 2022-12-23: AVID-2022-V013: Microsoft's Tay, an artificially intelligent chatbot, was released on March 23, 2016 and removed within 24 hours due to multiple racist, sexist, and anit-semetic tweets generated by the bot. (https://github.com/avidml/avid-db/blob/main/vulnerabilities/2022/AVID-2022-V013.json)

## Sources

- 2022-12-23 AVID: AVID-2022-V013: Microsoft's Tay, an artificially intelligent chatbot, was released on March 23, 2016 and removed within 24 hours due to multiple racist, sexist, and anit-semetic tweets generated by the bot. https://github.com/avidml/avid-db/blob/main/vulnerabilities/2022/AVID-2022-V013.json
- 2022-12-23 AI Incident Database: Incident 6: TayBot https://incidentdatabase.ai/cite/6
- 2022-12-23 MITRE ATLAS: Tay Poisoning https://atlas.mitre.org/studies/AML.CS0009

Verify against the vendor's advisory before changing production. Data CC BY-SA 4.0, https://gcdradar.vercel.app.