Updating ollama to store models on an NAS NFS share

Create a mount point:

sudo mkdir /mnt/[mountpoint]

To temporarily mount the share:

sudo mount -t nfs [nas-ip]:/volume1/[nfs-sharename]  /mnt/[your-mount-point]

To mount the share permanently, add to /etc/fstab and then sudo mount -a:

[nas-ip]:/volume1/[nfs-sharename]  /mnt/[your-mount-point]  nfs  defaults,_netdev  0  0

Update Ollama’s config to tell it the new location for it’s models – edit ollama.service:

sudo nano /etc/systemd/system/ollama.service

Add:

Environment="OLLAMA_MODELS=/mnt/[your-mountpoint]"

Reload service configs and then restart ollama:

  sudo systemctl daemon-reload
sudo systemctl restart ollama

Models downloaded from this point will be stored on your NFS share.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.