TinkersDocs

NetworkChuck

Listed Steps

Operating system: Ubuntu 22

Install WSL (Windows CMD) and Ubuntu

wsl --install

Connected to a WSL instance in a new window

wsl -d Ubuntu

Install Ollama Command for install on webpage

Add a model to Ollama

ollama pull llama2

“Watch” GPU performance in Linux

watch -n 0.5 nvidia-smi

Install Docker Add Docker's official GPG key:

sudo apt-get update

sudo apt-get install ca-certificates curl

sudo install -m 0755 -d /etc/apt/keyrings

sudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc

sudo chmod a+r /etc/apt/keyrings/docker.asc

Add the respository to Apt sources

echo \
"deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
$(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
sudo tee /etc/apt/sources.list.d/docker.list > /dev/null

sudo apt-get update

Install Docker

sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin

Run open webui docker container

sudo docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434/ --name open-webui --restart always ghcr.io/open-webui/open-webui:main

Make it executable

chmod +x webui.sh

Run it

./webui.sh --listen --api

Ollama Website

https://ollama.com/download