Back to all lessons
Awareness Lessons
3 days ago

Build System Escape and OIDC Misconfiguration Let Attackers Steal $740K in AI API Keys

Written by AI from the linked story. Not reviewed by an editor. How this works

Railway suffered a chained attack where a flaw in build system isolation allowed threat actors to escape the sandbox and access customer secrets and internal code. A subsequent OIDC trust misconfiguration compounded the damage by exposing cloud credentials, enabling decryption of stored secrets and theft of AI provider API keys — likely used for LLMjacking, running unauthorized AI workloads at the victim's expense. This incident illustrates how a single misconfiguration in a CI/CD or cloud trust boundary can cascade into catastrophic credential exposure. The scale of financial harm — $740,000 in unauthorized charges — underscores that secrets stored in build and cloud environments are high-value targets requiring strict isolation and least-privilege controls.

Tactical Insight

Immediate actions

  • Audit and harden all OIDC trust configurations to restrict token acceptance to explicitly defined, minimally scoped audiences and subjects.
  • Rotate all secrets and API keys stored in the build environment and audit which were potentially exposed during the incident window.
  • Enforce strict build sandbox isolation using containerization and kernel-level controls (e.g., seccomp, namespaces) to prevent escape.

Long-term improvements

  • Apply the principle of least privilege to all cloud IAM roles assumed via OIDC, ensuring build pipelines cannot access production secrets.
  • Adopt a secrets management platform (e.g., HashiCorp Vault, AWS Secrets Manager) with dynamic, short-lived credentials instead of static API keys.
  • Regularly penetration-test build and CI/CD pipeline isolation to discover escape vectors before attackers do.

Detection measures

  • Implement real-time alerting on anomalous cloud API usage, especially unexpected AI provider API calls or sudden spend spikes.
  • Log and monitor all secret access events within the build environment and cloud credential vending systems to detect unauthorized retrieval.
  • Set hard budget alerts and usage quotas on AI provider accounts to limit the financial impact of LLMjacking attacks.

Back this up with a control

All controls and vendors

Training helps people spot this. These controls make the attack fail even on the day someone does not.