Ollama LLM on the Radxa Rock 5B 16GB Rockchip RK3588

Аватар автора
Ethereal Exchanges
In this video I show you Ollama to work with Large Language Models on the Radxa Rock 5B with 16GB RAM and the Rockchip RK3588. You can use Ollama as a chatbot, like ChatGPT, but with Llava you can also use it for image recognition. Example commands: ollama run llama2:13b ollama run llama2 "Summarize this file: $(cat README.md)" 00:00 Intro 00:30 Ollama Github 03:00 Model File Installation Error 04:00 Running llama2:13b 15:22 Result of the 13B Model File 15:45 Running llama2 (7b) 21:20 Result of the 7B Model File 22:30 Hallucination? 25:25 LlaVA Image Recognition 29:50 Summarize text with Ollama 34:10 Extract text from PDF 35:35 LlaVA Result Used documents: If this video was helpful, please like, comment and subscribe! #ollama

0/0


0/0

0/0

0/0