doru/intelligence-router
1
0
Fork 0
Code Issues 17 Pull Requests Actions Packages Projects Releases Wiki Activity

Epic: Model Switching via Sidecar #1

New Issue
Open
opened 2026-06-15 02:46:11 +03:00 by doru · 0 comments
doru commented 2026-06-15 02:46:11 +03:00
Owner
Copy Link

PRD: Model Switching via Sidecar

The Intelligence Router currently routes LLM requests to a fixed backend. This epic implements dynamic model switching with zero manual intervention via a Sidecar service on the Main PC.

Scope

  • Sidecar service (systemd, manages llama-server subprocess)
  • Manifest profiles (YAML, multiple configs per GGUF)
  • Router refactored: Sidecar client, request queue, circuit breaker, fallback chain
  • Hermes model picker integration via /v1/models

Fallback chain

Main PC → OpenRouter (DeepSeek V4 Flash) → LXC

Child issues

Will be linked as child issues as they are created.

References

  • PRD: docs/prd/0001-model-switching-via-sidecar.md
  • ADR: docs/adr/0001-model-management-via-sidecar.md
  • CONTEXT: CONTEXT.md
# PRD: Model Switching via Sidecar The Intelligence Router currently routes LLM requests to a fixed backend. This epic implements dynamic model switching with zero manual intervention via a Sidecar service on the Main PC. ## Scope - Sidecar service (systemd, manages llama-server subprocess) - Manifest profiles (YAML, multiple configs per GGUF) - Router refactored: Sidecar client, request queue, circuit breaker, fallback chain - Hermes model picker integration via `/v1/models` ## Fallback chain Main PC → OpenRouter (DeepSeek V4 Flash) → LXC ## Child issues Will be linked as child issues as they are created. ## References - PRD: `docs/prd/0001-model-switching-via-sidecar.md` - ADR: `docs/adr/0001-model-management-via-sidecar.md` - CONTEXT: `CONTEXT.md`
doru added the
type:hitl
 label 2026-06-15 02:46:11 +03:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
triage:ready

Ready for AFK agent implementation

  
type:afk

Can be implemented autonomously without human interaction

  
type:hitl

Requires human interaction: architectural decision or design review

No Label
triage:ready
type:afk
type:hitl
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: doru/intelligence-router#1
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?