3. Automatic model detection and switch #4

New Issue

doru · 2026-06-15T02:48:58+03:00

doru commented

2026-06-15 02:48:58 +03:00

Parent

#1 Epic: Model Switching via Sidecar

What to build

Router parses the model field from incoming chat completion requests, queries Sidecar for the active model, and triggers a switch if the active profile mismatches the requested model.

Router proxy endpoint — extracts model from chat completion JSON body, maps it to profile_id, queries Sidecar GET /models/status. If active_profile matches → route to Main PC. If mismatch or no active → POST to Sidecar /models/switch with profile_id, queue request, wait for readiness, then route.

Acceptance criteria

Router extracts model field from chat completion request body
Router queries Sidecar status before each request (stateless routing)
Matching active model → routes directly to Main PC
Mismatching model → triggers switch, queues request, waits for ready, then routes
No active model → triggers switch (cold start)
Tests: active model match routes to Main PC, mismatch triggers switch + queue, no active model triggers cold start

Blocked by

#3 (Sidecar model switch + Router request queue)

User stories covered

5, 16

## Parent - #1 Epic: Model Switching via Sidecar ## What to build Router parses the `model` field from incoming chat completion requests, queries Sidecar for the active model, and triggers a switch if the active profile mismatches the requested model. - **Router** proxy endpoint — extracts `model` from chat completion JSON body, maps it to profile_id, queries Sidecar `GET /models/status`. If `active_profile` matches → route to Main PC. If mismatch or no active → POST to Sidecar `/models/switch` with profile_id, queue request, wait for readiness, then route. ## Acceptance criteria - [ ] Router extracts `model` field from chat completion request body - [ ] Router queries Sidecar status before each request (stateless routing) - [ ] Matching active model → routes directly to Main PC - [ ] Mismatching model → triggers switch, queues request, waits for ready, then routes - [ ] No active model → triggers switch (cold start) - [ ] Tests: active model match routes to Main PC, mismatch triggers switch + queue, no active model triggers cold start ## Blocked by - #3 (Sidecar model switch + Router request queue) ## User stories covered 5, 16

doru added the

type:afk

triage:ready

labels 2026-06-15 02:48:58 +03:00

doru referenced this issue

2026-06-15 02:48:58 +03:00

4. SSE switch progress feedback #5

doru referenced this issue

2026-06-15 02:48:58 +03:00

5. Circuit breaker + OpenRouter fallback #6

doru referenced this issue from a commit

2026-06-15 04:13:40 +03:00