Bing Chat Initial Instructions Exposed via Prompt Injection by Testers
Bing Chat
Early users successfully extracted Bing Chat's confidential system instructions and underlying rules through prompt injection techniques. Microsoft subsequently updated the system to address the disclosure.
- first report
- 8 Feb 2023
- last update
- 8 Feb 2023
Timeline · 1
Sources · 1
Research and catalogues
- 2023-02-08Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt InjectionAI Incident Database · incidentdatabase.ai/cite/473
Titles and links belong to their publishers. The summary above is written by gcdRadar in its own words; data is CC BY-SA 4.0.
Classification
- lane
- Research
- AI role
- Attack on AI
- categories
- Prompt injectionData leak
- severity
- 1 · Research / proof of concept
- targets
- Microsoft, OpenAI
- mitre atlas
- AML.T0051 LLM Prompt Injection
- dates
- happened 8 Feb 2023 · first reported 8 Feb 2023
- origin
- AI Incident DatabaseDerived from the AI Incident Database (CC BY-SA 4.0).
- record
- confidence 0.95 · created 2026-10-18 06:33Z · updated 2026-10-18 06:59Z
Lane, AI role, categories and severity come from the classifier; the OWASP and ATLAS rows are derived from the categories. How these are assigned
Copy a brief
This record as a short Markdown brief, for a ticket, a chat or a coding agent.
the brief as text
# Bing Chat Initial Instructions Exposed via Prompt Injection by Testers https://gcdradar.vercel.app/incidents/bing-chat-initial-instructions-exposed-via-prompt-injection · AIR-2023-0021 · closed 2023-02-22 - Lane: Research - Severity: 1 (Research / proof of concept) - Fix status: Fix status unknown - First reported: 2023-02-08 - AI role: Attack on AI - Products: Bing Chat ## Summary Early users successfully extracted Bing Chat's confidential system instructions and underlying rules through prompt injection techniques. Microsoft subsequently updated the system to address the disclosure. ## What to do No action recorded; read the sources below and the vendor's advisory. ## Latest updates - 2023-02-08: Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt Injection (https://incidentdatabase.ai/cite/473) ## Sources - 2023-02-08 AI Incident Database: Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt Injection https://incidentdatabase.ai/cite/473 Verify against the vendor's advisory before changing production. Data CC BY-SA 4.0, https://gcdradar.vercel.app.
Related
- closedBing Chat Bing Chat Data Exfiltration via Indirect Prompt Injection
Research · since 2023 (approx.)
AI - closedChatGPT ChatGPT Conversation Exfiltration via Indirect Prompt Injection
Research · since May 2023 (approx.)
AI - closedMathGPT Code Execution in MathGPT via Prompt Injection
Research · since 28 Jan 2023
AI - closedAzure Storage Accidental Exposure of 38TB of Data by Microsoft AI Research
Breaches & attacks · Exploited · since 22 Jun 2023
AI - closedChatGPT LLM Application Frameworks Allow Remote Code Execution via Prompting
Research · since 26 Mar 2023 · updated 31 Mar 2023
AI - closedChatGPT ChatGPT Bug Exposes User Chat Histories and Payment Data
Breaches & attacks · Real loss · since 20 Mar 2023
AI