Ollama Setup and Model Management: Installation, Model Selection, Memory Management, and ARM64 Native

February 22, 2026

Ollama-Setup, Model-Management, Local-Inference-Configuration

Ollama, Local-Llm, Model-Management, Apple-Silicon, Arm64, Gpu-Memory, Quantization

Ollama, Docker

Ollama Setup and Model Management#

Ollama turns running local LLMs into a single command. It handles model downloads, quantization, GPU memory allocation, and exposes a REST API that any application can call. No Python environments, no CUDA driver debugging, no manual GGUF file management.

Installation#

# macOS
brew install ollama

# Linux (official installer)
curl -fsSL https://ollama.com/install.sh | sh

# Or run as a Docker container
docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

Start the Ollama server: