4. SSE switch progress feedback #5

New Issue

doru · 2026-06-15T02:48:58+03:00

doru commented

2026-06-15 02:48:58 +03:00

Parent

#1 Epic: Model Switching via Sidecar

What to build

While a model switch is in progress, the Router sends Server-Sent Events to the client so Hermes can show progress instead of a blank spinner.

Router — when a request is queued during a switch, returns an SSE stream with event: model_switching events at regular intervals. Events include switch state (e.g., "stopping current model", "starting new model", "waiting for readiness"). Once Sidecar reports ready, the actual request is processed and the response streams normally.
Sidecar — /models/status includes current switch phase (e.g., switching, stopping, starting, ready, idle).

Acceptance criteria

Queued requests receive SSE stream with event: model_switching
SSE events reflect current switch phase from Sidecar
SSE stream transitions to normal response when model is ready
Client sees progress feedback during cold starts
Tests: SSE events emitted during switch, phase progression visible

Blocked by

#4 (Automatic model detection and switch)

User stories covered

4

## Parent - #1 Epic: Model Switching via Sidecar ## What to build While a model switch is in progress, the Router sends Server-Sent Events to the client so Hermes can show progress instead of a blank spinner. - **Router** — when a request is queued during a switch, returns an SSE stream with `event: model_switching` events at regular intervals. Events include switch state (e.g., "stopping current model", "starting new model", "waiting for readiness"). Once Sidecar reports ready, the actual request is processed and the response streams normally. - **Sidecar** — `/models/status` includes current switch phase (e.g., `switching`, `stopping`, `starting`, `ready`, `idle`). ## Acceptance criteria - [ ] Queued requests receive SSE stream with `event: model_switching` - [ ] SSE events reflect current switch phase from Sidecar - [ ] SSE stream transitions to normal response when model is ready - [ ] Client sees progress feedback during cold starts - [ ] Tests: SSE events emitted during switch, phase progression visible ## Blocked by - #4 (Automatic model detection and switch) ## User stories covered 4

doru added the

type:afk

triage:ready

labels 2026-06-15 02:48:58 +03:00

doru referenced this issue

2026-06-15 02:48:58 +03:00

6. LXC fallback chain completion #7

doru referenced this issue from a commit

2026-06-15 04:13:40 +03:00

Epic: Model Switching via Sidecar — Issues #4-#7 + #8 deployment

Sign in to join this conversation.