Following docs here:
https://unsloth.ai/docs/get-started/install
Run:
curl -fsSL https://unsloth.ai/install.sh | sh
To start local only:
unsloth studio
To start to listen on network for requests:
unsloth studio -H 0.0.0.0 -p 8888
I have downloaded models via ollama on a mounted NFS drive, usloth can pick them up automatically if you set OLLAMA_MODELS first:
#!/usr/bin/env bash
export OLLAMA_MODELS=/mnt/llms/ollama
unsloth studio -H 0.0.0.0 -p 8888
