User Tools

Site Tools


setupaiubuntu22

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
setupaiubuntu22 [2025/05/14 22:52] tektinkerssetupaiubuntu22 [2025/05/14 23:21] (current) tektinkers
Line 22: Line 22:
 **Add a model to Ollama** **Add a model to Ollama**
 <code>ollama pull llama2</code> <code>ollama pull llama2</code>
 +
 +**"Watch" GPU performance in Linux**
 +<code>watch -n 0.5 nvidia-smi</code>
 +
 +**Install Docker**
 +//Add Docker's official GPG key://
 +<code>sudo apt-get update</code>
 +<code>sudo apt-get install ca-certificates curl</code>
 +<code>sudo install -m 0755 -d /etc/apt/keyrings</code>
 +<code>sudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc</code>
 +<code>sudo chmod a+r /etc/apt/keyrings/docker.asc</code>
 +
 +**Add the respository to Apt sources**
 +<code>echo \
 +"deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
 +$(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
 +sudo tee /etc/apt/sources.list.d/docker.list > /dev/null</code>
 +<code>sudo apt-get update</code>
 +
 +//Install Docker//
 +<code>sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin</code>
 +
 +**Run open webui docker container**
 +<code>sudo docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434/ --name open-webui --restart always ghcr.io/open-webui/open-webui:main</code>
 +
 +**Make it executable**
 +<code>chmod +x webui.sh</code>
 +
 +//Run it//
 +
 +<code>./webui.sh --listen --api</code>
 +
 +**Ollama Website**
 +<code>https://ollama.com/download</code>
setupaiubuntu22.1747263156.txt.gz · Last modified: 2025/05/14 22:52 by tektinkers