EnterpriseArchitect/services/nvidia_sidecar/__init__.py at 474f1eddfde42b3ef2e2d3c64ac2df26531dc21d - EnterpriseArchitect - BizWings Git 仓库

vincent/EnterpriseArchitect

Files

T

vincent 611ebd11a8 feat(sidecar-v2): implement multi-pool provider proxy with cooldown, rate limiting, WebUI

BIZ-52 Step3 开发实现:
- storage: backend/usage/cooldown/config CRUD with SQLite WAL
- crypto: AES-256-GCM API key encryption
- pool_manager: primary/fallback pool routing
- cooldown_manager: 429 exponential backoff cooldown
- rate_limiter: per-backend token bucket RPM control
- router: model → backend routing with pool priority
- proxy: multi-pool request forwarding with retry
- server: FastAPI admin API + OpenAI-compatible proxy + SSE
- dashboard: WebUI with provider CRUD, stats, charts

Co-authored-by: multica-agent <github@multica.ai>

2026-06-25 16:39:01 +08:00

1 line

98 B

Python

Raw Blame History

"""Sidecar V2 — Multi-pool provider proxy with cooldown, rate limiting, and WebUI management."""