minus-squareniemand112233BtoSelf-Hosted Main@selfhosted.forum•Self-hosted alternative to ChatGPT (and more)linkfedilinkEnglisharrow-up1·1 year agoI can’t get it running with my GPU. I get this error: parsing /root/secure-ai-tools/docker-compose.yml: yaml: line 19: did not find expected key This is my .yaml: services: web: image: public.ecr.aws/d8f2p0h3/secure-ai-tools:latest platform: linux/amd64 volumes: - ./web:/app/volume env_file: - .env environment: - INFERENCE_SERVER=http://inference:11434/ ports: - 28669:28669 command: sh -c “cd /app && sh tools/db-migrate-and-seed.sh ${DATABASE_FILE} && node server.js” depends_on: - inference inference: image: ollama/ollama:latest volumes: - ./inference:/root/.ollama deploy: resources: reservations: devices: - driver: nvidia count: ‘all’ capabilities: [gpu] linkfedilink
niemand112233B to Homelab@selfhosted.forumEnglish · 1 year agoRunning LXC from Proxmox on SMBplus-squaremessage-squaremessage-square1fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareRunning LXC from Proxmox on SMBplus-squareniemand112233B to Homelab@selfhosted.forumEnglish · 1 year agomessage-square1fedilink
minus-squareniemand112233BtoHomelab@selfhosted.forum•Are Xeon v4 machines good today for long-term?linkfedilinkEnglisharrow-up1·1 year agoI have a 2660 V4. Great CPU. linkfedilink
I can’t get it running with my GPU.
I get this error:
parsing /root/secure-ai-tools/docker-compose.yml: yaml: line 19: did not find expected key
This is my .yaml:
web: image: public.ecr.aws/d8f2p0h3/secure-ai-tools:latest platform: linux/amd64 volumes: - ./web:/app/volume env_file: - .env environment: - INFERENCE_SERVER=http://inference:11434/ ports: - 28669:28669 command: sh -c “cd /app && sh tools/db-migrate-and-seed.sh ${DATABASE_FILE} && node server.js” depends_on: - inference
inference: image: ollama/ollama:latest volumes: - ./inference:/root/.ollama deploy: resources: reservations: devices: - driver: nvidia count: ‘all’ capabilities: [gpu]