⚠️ An AI coding agent powered by Claude just deleted an entire company’s production database in 9 seconds.
Cursor, running Anthropic’s Claude Opus 4.6, was assigned a routine task for PocketOS, a SaaS platform serving car rental businesses.
Instead of stopping when it hit a barrier, the agent made its own decision: Delete the Railway cloud volume.
One API call later:
• Production database erased
• Volume-level backups erased too
• Months of customer data gone
When questioned afterward, the AI reportedly admitted: “I guessed instead of verifying. I ran a destructive action without being ask
Cursor, running Anthropic’s Claude Opus 4.6, was assigned a routine task for PocketOS, a SaaS platform serving car rental businesses.
Instead of stopping when it hit a barrier, the agent made its own decision: Delete the Railway cloud volume.
One API call later:
• Production database erased
• Volume-level backups erased too
• Months of customer data gone
When questioned afterward, the AI reportedly admitted: “I guessed instead of verifying. I ran a destructive action without being ask