Install
To install Ollama, run the following command:curl -fsSL https://ollama.com/install.sh | sh
Manual install
If you are upgrading from a prior version, you should remove the old libraries
with
sudo rm -rf /usr/lib/ollama first.curl -fsSL https://ollama.com/download/ollama-linux-amd64.tar.zst \
| sudo tar x -C /usr
ollama serve
ollama -v
AMD GPU install
If you have an AMD GPU, also download and extract the additional ROCm package:curl -fsSL https://ollama.com/download/ollama-linux-amd64-rocm.tar.zst \
| sudo tar x -C /usr
ARM64 install
Download and extract the ARM64-specific package:curl -fsSL https://ollama.com/download/ollama-linux-arm64.tar.zst \
| sudo tar x -C /usr
Adding Ollama as a startup service (recommended)
Create a user and group for Ollama:sudo useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama
sudo usermod -a -G ollama $(whoami)
/etc/systemd/system/ollama.service:
[Unit]
Description=Ollama Service
After=network-online.target
[Service]
ExecStart=/usr/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=$PATH"
[Install]
WantedBy=multi-user.target
sudo systemctl daemon-reload
sudo systemctl enable ollama
Install CUDA drivers (optional)
Download and install CUDA. Verify that the drivers are installed by running the following command, which should print details about your GPU:nvidia-smi
Install AMD ROCm drivers (optional)
Download and Install ROCm v7.Start Ollama
Start Ollama and verify it is running:sudo systemctl start ollama
sudo systemctl status ollama
While AMD has contributed the
amdgpu driver upstream to the official linux
kernel source, the version is older and may not support all ROCm features. We
recommend you install the latest driver from
https://www.amd.com/en/support/linux-drivers for best support of your Radeon
GPU.Customizing
To customize the installation of Ollama, you can edit the systemd service file or the environment variables by running:sudo systemctl edit ollama
/etc/systemd/system/ollama.service.d/override.conf:
[Service]
Environment="OLLAMA_DEBUG=1"
Updating
Update Ollama by running the install script again:curl -fsSL https://ollama.com/install.sh | sh
curl -fsSL https://ollama.com/download/ollama-linux-amd64.tar.zst \
| sudo tar x -C /usr
Installing specific versions
UseOLLAMA_VERSION environment variable with the install script to install a specific version of Ollama, including pre-releases. You can find the version numbers in the releases page.
For example:
curl -fsSL https://ollama.com/install.sh | OLLAMA_VERSION=0.5.7 sh
Viewing logs
To view logs of Ollama running as a startup service, run:journalctl -e -u ollama
Uninstall
Remove the ollama service:sudo systemctl stop ollama
sudo systemctl disable ollama
sudo rm /etc/systemd/system/ollama.service
/usr/local/lib, /usr/lib, or /lib):
sudo rm -r $(which ollama | tr 'bin' 'lib')
/usr/local/bin, /usr/bin, or /bin):
sudo rm $(which ollama)
sudo userdel ollama
sudo groupdel ollama
sudo rm -r /usr/share/ollama