Sebastian Maniak MANIAK. AI infrastructure
Home Articles About
X / Twitter YouTube LinkedIn
Search
TAG

#Vllm

4 articles tagged “Vllm”.

Agentgateway 28 Mcp 24 Kagent 18 A2a 10 Kubernetes 10 Vault 9 Agent Substrate 8 Gitops 8 GVisor 8 Observability 7 Hitl 6 Openai 6 Standalone 6 Telegram 6 Entra 5 Helm 5 Llm 5 Qwen 5 Agentdesktop 4 Cost 4 Docker 4 HA 4 Langfuse 4 Solo Enterprise 4 Vllm 4 BIG-IP 3 Dgx-Spark 3 F5 3 Grok 3 Kind 3 Llm-Gateway 3 PostgreSQL 3 Actors 2 Bedrock 2 Budgets 2 Claude 2 Devops 2 FortiGate 2 Fortinet 2 Gateway 2 Gateway-Api 2 GCP 2 Guardrails 2 Jwt 2 Lxc 2 Multi-Agent 2 Oauth 2 Openclaw 2 Opentelemetry 2 Pi 2 Proxmox 2 Rbac 2 SandboxAgent 2 Security 2 Serverless 2 Sso 2 Virtual API Keys 2 Xai 2 AHV 1 Ai 1 Ai-Agents 1 Ai-Gateway 1 Anthropic 1 ArgoCD 1 Automation 1 AWS 1 Cel 1 Claude-Code 1 Claude-Desktop 1 Cloud SQL 1 Codex 1 Copilot 1 Deepseek 1 Dex 1 DNS 1 E-Ink 1 Embeddings 1 Failover 1 FastAPI 1 FinOps 1 Firewall 1 GCE 1 Github-Copilot-Cli 1 Governance 1 Gpt-5.5 1 Graph Engineering 1 Grok-Build 1 GTM 1 Harness 1 Homelab 1 Human-in-the-Loop 1 Identity Platform 1 Llm-Cost 1 LocalAI 1 LTM 1 Managed-Settings 1 Memory 1 NKP 1 NSX 1 Nutanix 1 Oidc 1 Opencode 1 Openmausbot 1 Oss 1 PaaS 1 Personal-Ai 1 Pkce 1 Rate-Limiting 1 Release 1 Remarkable 1 Render 1 RHEL 1 Self-Hosted 1 ServiceNow 1 Solo 1 Spacexai 1 SQLite 1 Systemd 1 Tailscale 1 Telemetry 1 Tokenomics 1 Tool Approval 1 Tracing 1 Twitter 1 Ui 1 Virtual-Keys 1 VMware 1 VSphere 1 X 1 Yaml 1
AI Gateway 30 Oct 2026

How To: Govern a Local Model Like a Cloud One: Pi on a DGX Spark, Through agentgateway, Managed by Agentdesktop

When the model runs on your own GPU, it is tempting to skip the gateway. The model is on the LAN and costs nothing per token, so why bother? Because …

agentgatewayagentdesktoppi
AI 22 Oct 2026

Running a Headless Pi Coding Agent in a Proxmox LXC, Chatting with It from Telegram, Powered by a Local Model on a DGX Spark

I wanted a coding agent I can reach from my phone, on a model that stays on hardware I control, with no ports forwarded in from the internet. Pi runs in an …

PiProxmoxLXC
AI 10 Jun 2026

agentgateway Standalone → Langfuse: Direct OTLP Tracing (No Collector)

I’ve already covered the production OTel Collector pattern for shipping agentgateway traces to Langfuse. This is the opposite end of the spectrum: the …

agentgatewayLangfuseOpenTelemetry
AI 09 Jun 2026

Running kagent on a kind Cluster with a Local vLLM + Qwen3 Backend

Running kagent on a kind Cluster with a Local vLLM + Qwen3 Backend By Sebastian Maniak Most kagent walkthroughs assume you’re pointing at OpenAI or …

kagentkindvLLM
Sebastian Maniak
MANIAK.
AI infrastructure notes

Field notes from Sebastian Maniak on AI agents, gateways, and cloud-native infrastructure in production.

© 2026 Sebastian Maniak. All rights reserved.
Home Articles About