feat(middleware): Model routing, PII filtering, Cloud model proxies#9802

Open

richiejp wants to merge 38 commits into

mudler:masterfrom

richiejp:feat/routing-stats-backend

Commits on May 14, 2026

feat(routing): add billing recorder and stats backend foundation
richiejp
committed
feat(routing): expose usage stats in REST, UI, and MCP
richiejp
committed
feat(routing): add regex PII filter with REST and MCP surfaces
richiejp
committed
feat(routing): record usage end-to-end in no-auth mode
richiejp
committed
feat(routing): per-model PII gating + middleware admin page
richiejp
committed
feat(routing): rule-based intelligent router (subsystem 2 MVP)
richiejp
committed
feat(routing): streaming PII filter with buffered-emit invariant
richiejp
committed
feat(routing): PII pattern editor in model config UI
richiejp
committed
feat(routing): streaming PII filter on Anthropic /v1/messages and /v1/completions
richiejp
committed
feat(routing): cloud passthrough proxy (subsystem 4 MVP)
richiejp
committed
docs(routing): cloud passthrough proxy feature page
richiejp
committed
feat(routing): MITM proxy for subscription-auth Claude Code / Codex
richiejp
committed
feat(mitm): negotiate HTTP/2 with h1.1 fallback
richiejp
committed
refactor(cloudproxy): extract shared SSE wire helpers, trim dead state and comments
richiejp
committed
feat(import-model): add cloud-proxy templates to YAML editor
richiejp
committed
Revert "feat(import-model): add cloud-proxy templates to YAML editor"
richiejp
committed
feat(model-editor): add cloud-proxy templates to Add Model picker
richiejp
committed
feat(mitm): runtime control of listener and intercept allowlist
richiejp
committed
feat(middleware-ui): MITM proxy admin tab
richiejp
committed
refactor(mitm): simplify-pass cleanup
richiejp
committed
feat(mitm): emit proxy_connect + proxy_traffic audit events
richiejp
committed
test(mitm): cover tunneled-host event + Events tab kind filter
richiejp
committed
fix(mitm): restore listener from runtime_settings.json on restart
richiejp
committed
fix(routing): address code-review findings across pii/mitm/router
richiejp
committed
feat(middleware): per-pattern PII toggle, model-config-owned MITM hosts
richiejp
committed
refactor(store/local): extract in-process vector store library
richiejp
committed
feat(routing): KNN + LLM classifiers and per-model admission control
richiejp
committed
refactor(store): keep the vector store out of the main process
richiejp
committed
feat(backend): TokenClassify RPC + transformers NER pipeline
richiejp
committed
fix(openai): add missing auth import to chat.go
richiejp
committed
feat(pii): NER tier in the redactor
richiejp
committed
feat(middleware-ui): router template + Create routing model link
richiejp
committed
fix(model-editor): code-editor crash on structured template values
richiejp
committed
feat(model-editor): structured router-candidates editor + proxy chat usecase
richiejp
committed
fix(router-candidates): one textarea per exemplar, multi-line-safe
richiejp
committed
feat(router): KNN consumes a benchmarker-produced routing dataset
richiejp
committed
docs(router): recommend nomic-embed-text-v1.5 over Longformer
richiejp
committed
feat(routing): Score gRPC primitive, score classifier, L2 embedding cache
richiejp
committed