7. Systemd service deployment #8

New Issue

doru · 2026-06-15T02:48:58+03:00

doru commented

2026-06-15 02:48:58 +03:00

Parent

#1 Epic: Model Switching via Sidecar

What to build

Package the Sidecar as a systemd service on the Main PC. This requires manual installation by the user.

Service unit file llm-sidecar.service — Restart=always, WantedBy=multi-user.target. Environment variable MANIFEST_PATH=/home/bigt/AI/llm/manifest.yaml. Sidecar port configurable via SIDECAR_PORT=8081.
No default model loaded — sidecar starts with no model active. User picks from Hermes model picker.
Auto-restart — systemd Restart=always ensures sidecar survives crashes. Sidecar auto-restarts llama-server subprocess up to 3 times (circuit breaker).
Install instructions — systemctl daemon-reload && systemctl enable --now llm-sidecar.

Acceptance criteria

llm-sidecar.service unit file created in deploy/ directory
Service starts automatically at boot
Service restarts on crash (Restart=always)
No model loaded on initial start
MANIFEST_PATH configurable via environment
Install script or instructions documented
systemctl status llm-sidecar shows running after install

Blocked by

#6 (LXC fallback chain completion) — all AFK slices should be complete before deployment

User stories covered

6, 9, 10

Note: This is a HITL slice — requires manual installation on the Main PC by the user.

## Parent - #1 Epic: Model Switching via Sidecar ## What to build Package the Sidecar as a systemd service on the Main PC. This requires manual installation by the user. - **Service unit file** `llm-sidecar.service` — `Restart=always`, `WantedBy=multi-user.target`. Environment variable `MANIFEST_PATH=/home/bigt/AI/llm/manifest.yaml`. Sidecar port configurable via `SIDECAR_PORT=8081`. - **No default model loaded** — sidecar starts with no model active. User picks from Hermes model picker. - **Auto-restart** — systemd `Restart=always` ensures sidecar survives crashes. Sidecar auto-restarts llama-server subprocess up to 3 times (circuit breaker). - **Install instructions** — `systemctl daemon-reload && systemctl enable --now llm-sidecar`. ## Acceptance criteria - [ ] `llm-sidecar.service` unit file created in `deploy/` directory - [ ] Service starts automatically at boot - [ ] Service restarts on crash (`Restart=always`) - [ ] No model loaded on initial start - [ ] `MANIFEST_PATH` configurable via environment - [ ] Install script or instructions documented - [ ] `systemctl status llm-sidecar` shows running after install ## Blocked by - #6 (LXC fallback chain completion) — all AFK slices should be complete before deployment ## User stories covered 6, 9, 10 > **Note:** This is a HITL slice — requires manual installation on the Main PC by the user.

doru added the

type:hitl

label 2026-06-15 02:48:58 +03:00

doru referenced this issue from a commit

2026-06-15 04:13:40 +03:00

Epic: Model Switching via Sidecar — Issues #4-#7 + #8 deployment

Sign in to join this conversation.