doru/intelligence-router
1
0
Fork 0
Code Issues 17 Pull Requests Actions Packages Projects Releases Wiki Activity

fix: resolve port conflict between sidecar and llama-server

Browse Source 
Sidecar and llama-server were both configured on port 8080, causing
llama-server to fail on startup (port already in use).

- sidecar/app.py: LLAMA_SERVER_PORT → 8081 (sidecar stays on 8080)
- docker-compose.yml: MAIN_PC_URL → port 8081 (router sends chat
  requests to llama-server, not the sidecar)
This commit is contained in:
root 2026-06-15 15:31:31 +00:00
parent 2c23faa4a1
commit 7e86a30bd8
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docker-compose.yml
View File

@ -8,7 +8,7 @@ services:
- "9001:9000" - "9001:9000"
environment: environment:
- SIDECAR_URL=http://10.0.4.11:8080 - SIDECAR_URL=http://10.0.4.11:8080
- MAIN_PC_URL=http://10.0.4.11:8080/v1 - MAIN_PC_URL=http://10.0.4.11:8081/v1
- FALLBACK_SLM_URL=http://10.0.4.200:8080/v1 - FALLBACK_SLM_URL=http://10.0.4.200:8080/v1
- OPENROUTER_API_KEY=${OPENROUTER_API_KEY:-} - OPENROUTER_API_KEY=${OPENROUTER_API_KEY:-}
restart: unless-stopped restart: unless-stopped

2
sidecar/app.py
View File

@ -18,7 +18,7 @@ from sidecar.manifest import load_manifest
# Configuration from environment # Configuration from environment
MANIFEST_PATH = os.getenv("MANIFEST_PATH", "/home/bigt/AI/llm/manifest.yaml") MANIFEST_PATH = os.getenv("MANIFEST_PATH", "/home/bigt/AI/llm/manifest.yaml")
SIDECAR_PORT = int(os.getenv("SIDECAR_PORT", "8080")) SIDECAR_PORT = int(os.getenv("SIDECAR_PORT", "8080"))
LLAMA_SERVER_PORT = 8080 LLAMA_SERVER_PORT = 8081
# Global state # Global state
_llama_server_process: Optional[asyncio.subprocess.Process] = None _llama_server_process: Optional[asyncio.subprocess.Process] = None