Further Resources

Official docs for everything covered in this guide.

• llama.cpp GitHub
• Ollama documentation
• vLLM documentation
• Hugging Face model hub
• Hugging Face transformers docs

Suggested learning path

1. Get Ollama running with a small model today (Tutorial 1).
2. Once comfortable, build llama.cpp from source and try manual quantization (Tutorial 2) to see what Ollama was hiding from you.
3. If you need Python-level control, move to transformers (Tutorial 3).
4. If you're serving more than one user, move to vLLM (Tutorial 4).
5. Build something — even a small CLI tool using the streaming client in Tutorial 5 — that's how the concepts actually stick.

Stuck, or want to talk through a design decision? Ask in the forum.