News
OWASP LLM05 Supply Chain Vulnerabilities: Mapping the Surface a Gateway Can Cover
4+ day, 8+ hour ago (1071+ words) The defenses split across the supply chain itself, the runtime, and the network boundary. The boundary slice is where a policy gateway operates. The gateway is not the AIBOM. The gateway is not the patch manager. The gateway is the…...
Prompt Injection Detection: The Three Inspection Layers That Actually Catch It in Production
2+ week, 4+ day ago (786+ words) I want to walk through what each layer catches, where the failure modes sit, and the runtime pattern that produces visibility across all three. The inbound prompt is the text sent from the client into the model. At this layer,…...
AI Egress Monitoring: The Outbound Inspection Layer Most Deployments Skip
2+ week, 4+ day ago (1212+ words) The visibility gap matters because the AI request boundary is where shadow AI sits, where prompt-leaked confidential data sits, and where the bulk of an enterprise's AI risk operates. I want to walk through what egress monitoring has to observe,…...
Ne Mo Guardrails Alternatives: What to Evaluate in 2026
3+ week, 2+ day ago (909+ words) I want to walk through six alternatives that come up in real procurement conversations, what each one architecturally is, and which one fits which deployment profile. Ne Mo Guardrails sits inside one Python application. The six alternatives below split into…...
Databricks AI Gateway Alternatives: When the Mosaic Layer Does Not Cover the Workload
1+ mon, 5+ day ago (696+ words) Teams whose LLM traffic does not run primarily inside Databricks Model Serving pick an operational gateway that does not depend on the Databricks runtime. Kong AI Gateway is the AI-focused plugin family on the Kong data plane: multi-provider LLM routing…...
Deep Inspect vs Langfuse: Where LLM Observability Stops and Inline Enforcement Starts
1+ mon, 5+ day ago (539+ words) Langfuse observes after the fact. Deep Inspect enforces inline. I want to walk through what each one does, where the responsibilities split, and how the two layers compose in production. The architectural sweet spot for Langfuse is the AI engineering…...
Kong AI Gateway Alternatives: How to Pick a Different Layer When Kong Does Not Cover Your Workload
1+ mon, 5+ day ago (680+ words) Helicone is an open-source LLM observability platform with an async proxy and a self-hosted gateway. The dashboard exposes captured calls by user, model, route, custom property, latency, and cost. The async proxy mode does not require SDK changes for most…...
Langfuse Alternatives: How to Pick a Different LLM Observability or Enforcement Layer
1+ mon, 5+ day ago (643+ words) Teams that want LLM observability without adding SDK calls inside the application code pick a proxy-based product. Helicone is an open-source LLM observability platform with an async proxy and a self-hosted gateway. The dashboard exposes captured calls by user, model,…...
Deep Inspect vs MLflow AI Gateway: Where Model Routing Stops and Policy Enforcement Starts
1+ mon, 5+ day ago (589+ words) I want to walk through what MLflow AI Gateway does, what Deep Inspect does, and where the two layers compose for regulated AI workloads. The architectural sweet spot for MLflow AI Gateway is the ML platform team that has standardized…...
Portkey Alternatives: How to Pick a Different LLM Gateway and Observability Layer
1+ mon, 5+ day ago (872+ words) Teams that want the multi-provider gateway feature without a closed-source dependency pick an open-source alternative. Lite LLM is an open-source LLM proxy with an Open AI-compatible API surface across 100+ providers. The proxy server handles routing, retries, fallbacks, basic key management,…...