Executive Summary
In February 2026, Wiz Research discovered that nearly 10% of internet-facing LiteLLM AI gateway servers accepted the default administrator key 'sk-1234' from the platform's setup documentation. This misconfiguration exposed API keys for multiple AI model providers, allowed access to cloud IAM credentials through metadata services, and granted attackers full administrative control over affected gateways. The vulnerability enabled LLMjacking attacks where threat actors could consume AI services at victims' expense, while also providing pathways to broader cloud infrastructure compromise.
This incident highlights the growing security risks in AI infrastructure as organizations rapidly deploy AI gateways without proper hardening. With over 85,000 LiteLLM instances discovered by August 2026 and active exploitation of related vulnerabilities already documented, the misconfiguration represents a critical gap in AI security posture management across cloud environments.
Why This Matters Now
AI gateway misconfigurations are becoming a primary attack vector as organizations rush to deploy AI infrastructure without implementing proper security controls, creating widespread exposure of valuable API credentials and cloud access paths.
Attack Path Analysis
Attackers exploited LiteLLM gateways using default 'sk-1234' admin keys to gain administrative access, escalated privileges through guardrail bypass vulnerabilities, moved laterally via pass-through endpoints to cloud metadata services, established command and control through MCP sessions, exfiltrated API keys and cloud credentials, and potentially deployed cryptocurrency miners or ransomware for impact.
Kill Chain Progression
This analysis maps confirmed threat intelligence to the full cloud kill chain to show where defensive gaps would emerge as an attack progresses.
Initial Compromise
Description
Attackers scanned internet-facing LiteLLM gateways and gained admin access using default 'sk-1234' master key or exploited unauthenticated instances
Related CVEs
CVE-2024-59821
CVSS 2.1A vulnerability in LiteLLM before 1.82.0-stable allows authenticated administrators to execute arbitrary code by bypassing guardrail checks when creating or updating custom code guardrails.
Affected Products:
BerriAI LiteLLM – < 1.82.0-stable
Exploit Status:
proof of conceptCVE-2024-40217
CVSS 7.2A guardrail sandbox escape vulnerability in LiteLLM versions 1.81.8 to 1.83.10 allows code execution as root in the default Docker container image using bytecode techniques.
Affected Products:
BerriAI LiteLLM – 1.81.8 to < 1.83.10
Exploit Status:
proof of conceptCVE-2024-59822
CVSS 8.8An authentication bypass vulnerability in LiteLLM before 1.84.0 allows unauthenticated attackers to establish MCP sessions using any Bearer token, including single-character tokens.
Affected Products:
BerriAI LiteLLM – < 1.84.0
Exploit Status:
exploited in the wildCVE-2024-42271
CVSS 7.8A command execution vulnerability in LiteLLM versions 1.74.2 to 1.83.7 allows authenticated users to run arbitrary commands on the host through MCP test endpoints.
Affected Products:
BerriAI LiteLLM – 1.74.2 to < 1.83.7
Exploit Status:
exploited in the wild
MITRE ATT&CK® Techniques
Valid Accounts
Unsecured Credentials: Cloud Instance Metadata API
Impair Defenses: Disable or Modify Cloud Firewall
Command and Scripting Interpreter: Python
Exploitation for Privilege Escalation
Data from Cloud Storage Object
Resource Hijacking
Potential Compliance Exposure
Mapping incident impact across multiple compliance frameworks.
PCI DSS 4.0 – Vendor Default Accounts and Parameters
Control ID: Requirement 2.2
NYDFS 23 NYCRR 500 – Penetration Testing and Vulnerability Assessments
Control ID: Section 500.15
DORA – Identification and Classification of ICT Assets
Control ID: Article 8
CISA ZTMM 2.0 – Multi-Factor Authentication and Strong Authentication
Control ID: Identity Pillar
NIS2 Directive – Cybersecurity Risk Management Measures
Control ID: Article 21
ISO 27001 – Password Management System
Control ID: A.9.4.3
Sector Implications
Industry-specific impact of the vulnerabilities, including operational, regulatory, and cloud security risks.
Financial Services
LiteLLM gateway vulnerabilities expose API keys and enable cloud account compromise, threatening financial data integrity and regulatory compliance requirements.
Health Care / Life Sciences
AI gateway misconfigurations risk patient data exposure through encrypted traffic vulnerabilities and cloud credential theft, violating HIPAA compliance frameworks.
Information Technology/IT
Cloud misconfiguration in AI gateways enables lateral movement and exfiltration, compromising multi-cloud visibility and zero trust segmentation controls.
Computer Software/Engineering
Default authentication keys in LiteLLM create privilege escalation risks, exposing Kubernetes environments and cloud-native security fabric to compromise.
Sources
- Nearly 1 in 10 Exposed LiteLLM Gateways Accepted the Example "sk-1234" Admin Keyhttps://thehackernews.com/2026/09/nearly-1-in-10-exposed-litellm-gateways.htmlVerified
- Off Guard: Breaking LiteLLM from Authentication Bypass to Cloud Compromisehttps://www.wiz.io/blog/off-guard-breaking-litellm-from-authentication-bypass-to-cloud-compromiseVerified
- CISA Known Exploited Vulnerabilities Cataloghttps://www.cisa.gov/known-exploited-vulnerabilities-catalogVerified
- LiteLLM Security Advisory GHSA-72m8-9m7m-h278https://github.com/BerriAI/litellm/security/advisories/GHSA-72m8-9m7m-h278Verified
- When AI Infrastructure Becomes Target: Securing Gateways Control Pointshttps://www.microsoft.com/en-us/security/blog/2024/08/26/when-ai-infrastructure-becomes-target-securing-gateways-control-pointsVerified
Frequently Asked Questions
Cloud Native Security Fabric Mitigations and ControlsCNSF
Based on the attack progression modeled above, these are the defensive controls that would constrain each stage.
Aviatrix Zero Trust CNSF would have constrained this LiteLLM gateway compromise by limiting lateral movement to cloud metadata services and reducing the blast radius of credential exfiltration across multi-cloud environments.
Control: Cloud Native Security Fabric (CNSF)
Mitigation: Zero trust fabric would likely have constrained the initial attack surface by implementing identity-aware access controls and reducing exposure of administrative interfaces to untrusted networks.
Control: Zero Trust Segmentation
Mitigation: Zero trust segmentation would likely have limited the scope of privilege escalation by constraining container breakout attempts and reducing access to underlying host resources through workload isolation.
Control: East-West Traffic Security
Mitigation: East-west traffic controls would likely have constrained lateral movement by blocking unauthorized access to cloud metadata endpoints and reducing the attacker's ability to traverse between workloads and cloud services.
Control: Multicloud Visibility & Control
Mitigation: Multicloud visibility controls would likely have detected and constrained unauthorized command and control sessions by monitoring cross-cloud communication patterns and limiting persistent connection establishment across cloud boundaries.
Control: Egress Security & Policy Enforcement
Mitigation: Egress security policies would likely have constrained data exfiltration by limiting outbound communication paths and reducing the attacker's ability to transfer sensitive credentials and database contents to external destinations.
While mining deployment scope would likely have been constrained to segmented workloads, stolen API keys could still enable LLMjacking attacks against external model providers beyond the protected infrastructure perimeter.
Impact at a Glance
Affected Business Functions
- AI Gateway Operations
- API Key Management
- Cloud Infrastructure Security
- Model Provider Access Control
Estimated downtime: 3 days
Estimated loss: $50,000
API keys for model providers, cloud IAM credentials, database connection strings, model usage data, and internal application prompts and responses passing through AI gateways
Recommended Actions
Key Takeaways & Next Steps
- • Implement Zero Trust Segmentation to isolate AI gateways and prevent lateral movement to cloud metadata services
- • Deploy Egress Security & Policy Enforcement to block unauthorized outbound connections and data exfiltration attempts
- • Enable Multicloud Visibility & Control to detect anomalous interactions and repeated malformed requests targeting AI infrastructure
- • Implement Threat Detection & Anomaly Response to baseline normal AI gateway behavior and alert on suspicious administrative activities
- • Apply Cloud Native Security Fabric (CNSF) controls to provide real-time inspection and distributed policy enforcement for AI workloads and shadow AI detection



