Hello Forum! Just got finished putting the finishing touches on the newest addition to the Pi-Apps store: Ollama GUI.
Even without an Internet connection, it works fine on a 8GB Pi5, and it answers any question you throw at it (to varying degrees of accuracy)The text you see above took around 2 minutes to generate. This is slow compared to Cloud LLMs like ChatGPT, but if you are on-the-go and have no WiFi signal, this would be more than sufficient for answering questions.
Install it from Pi-Apps and you get two LLMs preinstalled: Codellama:7b and Phi3:mini. Codellama is geared towards programming - perfect for getting help with linux commands or writing code. Phi3 is the best general-purpose ChatGPT equivalent I could find that runs decently. It runs faster and seems to hallucinate less than Llama3 models of this size. source
Ollama GUI as seen in the screenshot is my own fork of another project. I fixed a few issues with it.
Use Pi-Apps to download and install this all automatically. No terminal experience required.
If you don't use Pi-Apps yet, here are step-by-step instructions: https://pi-apps.io/install-app/install- ... pberry-pi/
Please comment below if it runs well, or if you had any issues getting it to run okay.
Even without an Internet connection, it works fine on a 8GB Pi5, and it answers any question you throw at it (to varying degrees of accuracy)
Install it from Pi-Apps and you get two LLMs preinstalled: Codellama:7b and Phi3:mini. Codellama is geared towards programming - perfect for getting help with linux commands or writing code. Phi3 is the best general-purpose ChatGPT equivalent I could find that runs decently. It runs faster and seems to hallucinate less than Llama3 models of this size. source
Ollama GUI as seen in the screenshot is my own fork of another project. I fixed a few issues with it.
Use Pi-Apps to download and install this all automatically. No terminal experience required.
If you don't use Pi-Apps yet, here are step-by-step instructions: https://pi-apps.io/install-app/install- ... pberry-pi/
Please comment below if it runs well, or if you had any issues getting it to run okay.
Statistics: Posted by Botspot — Fri Jan 31, 2025 4:40 am