Claude 8a1ac05f1e Add single self-contained local-ai-setup.sh
Merges all components into one script — no separate server files needed.
Embeds server.py (RAG) and mcp_server.py (MCP) as inline heredocs.

- Auto-detects VRAM and sets models + context window accordingly:
  6GB  → 7B models, 8k ctx
  8GB+ → 14B chat + 7B code, 16k ctx
  16GB → 14B models, 32k ctx (V100/A100 friendly)
- New install or update (detects existing compose)
- --force flag to overwrite config files
- --no-pull to skip model download prompt
- Adds fetch_url tool to MCP server
- Optional DeepSeek-R1:14b pull for reasoning tasks

https://claude.ai/code/session_012gDnantBmFTWZGCiKyjazx
2026-03-20 15:14:10 +00:00
2026-03-19 22:25:26 -04:00
S
Description
Mirror of outis1one/local-ai from GitHub
628 KiB
Languages
Shell 95.4%
Python 4.6%