Local Models

I use local models where privacy, control over data, cost or independence from an external API is what counts. I match the model and the way it is served to the actual task and the hardware at hand.

Local LLMs, Ollama, llama.cpp, vLLM, Hugging Face, Llama, Mistral, Qwen, Quantization, Self-Hosted AI