Running large language models (LLMs) locally has often meant accepting slower speeds and tighter memory limits. Ollama’s latest update, built on Apple’s MLX framework, goes some way toward easing those constraints – especially for developers running AI agents directly on their machines.
In tandem, the release also introduces support for NVIDIA’s NVFP4 format, which targets memory efficiency for larger models.
For context, Ollama is runtime for LLMs with an open core that can be run locally, with a growing catalogue of…
