Ollama
More info
- Creator
- Jeffrey Morgan et al.
- Released
- Type
- Local LLM runner
- License
- MIT
- Website
- ollama.com
- Source
- github.com/ollama/ollama
- Wikipedia
- en.wikipedia.org
Tool for running LLMs locally on your own machine — ollama run llama3 and you're chatting.
Wraps llama.cpp + a library of quantised models. CPU or GPU acceleration automatically. Good for private data, offline use, prototypes. Apple Silicon Macs love it.