Installing Unsloth Studio and re-using ollama download gguf models

Following docs here:

https://unsloth.ai/docs/get-started/install

Run:

curl -fsSL https://unsloth.ai/install.sh | sh

To start local only:

unsloth studio

To start to listen on network for requests:

unsloth studio -H 0.0.0.0 -p 8888

I have downloaded models via ollama on a mounted NFS drive, usloth can pick them up automatically if you set OLLAMA_MODELS first:

#!/usr/bin/env bash
export OLLAMA_MODELS=/mnt/llms/ollama
unsloth studio -H 0.0.0.0 -p 8888

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.