guides
Give Docker enough memory
When the model runs on the CPU inside Docker, Docker needs at least 8 GB. How to set it on Mac, Windows and Linux.
When the model runs on the CPU inside Docker, Docker needs at least 8 GB of memory.
Mac (Docker Desktop)
Open Docker Desktop, then Settings, Resources, Advanced, and raise the Memory limit.
Windows (WSL 2)
With WSL 2, the default, Docker gets WSL's memory, which is half the PC's RAM by default. To change it, put these two lines in %UserProfile%\.wslconfig:
ini
[wsl2]
memory=8GBThen restart WSL and Docker Desktop:
powershell
wsl --shutdownMac without Docker Desktop (Colima)
bash
brew install colima docker docker-credential-helper
colima start --cpus 6 --memory 8Colima has no Docker Model Runner, so the model runs on the CPU.
Linux
Use Docker Engine. It uses the host's memory directly, so make sure the machine has at least 8 GB free.