Local-llm

2 articles

ollama7 min read

Ollama — Run LLMs Locally on Mac, Linux and Windows 2026

Learn how to install Ollama and run large language models locally on your own hardware without internet access or API keys. This guide covers installation, model management, Python integration, LangChain setup, custom Modelfiles, and production considerations.

Read →
mixtral8 min read

Mixtral 8x7B — Mixture of Experts Complete Guide 2026

Deep dive into Mixtral 8x7B — the Mixture of Experts model that delivers 70B-class quality at 7B inference cost. This guide covers the MoE architecture, local setup, quantization, chat formatting, multi-GPU inference, and production deployment for ML engineers.

Read →