Local, on-prem, and private AI news
Recent stories and discussions about running AI on hardware you control. We link out to the original; read the source for the full story.
Headlines link to the original source. Summaries are our own one-line descriptions, not quotes. Picked automatically for relevance to local, on-prem, and private AI; inclusion is not an endorsement. Refreshed Oct 18, 2026.
- DeepSeek V4.1 Flash (1017) Now Leads Open-Weight Models
LocalLLaMA users are debating a claim that DeepSeek's new V4.1 Flash (1017) release now tops the open-weight model rankings, and what that means for people running models on their own hardware.
- deepseek-ai/DeepSeek-V4.1-Flash-1017 · Hugging Face
r/LocalLLaMA readers flag a new DeepSeek V4.1 Flash checkpoint posted to Hugging Face.
- Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware
A Show HN project that lets you preview how fast a local model would feel on given hardware before buying it.
- 10 Things you maybe didn't know you can do with Qwen 3.6 27B right now. (For Noobs)
A beginner-friendly r/LocalLLaMA post walks through practical things one user does with the Qwen 3.6 27B model running at home.
- Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console
An open-source project ports llama.cpp to a jailbroken PS5 so the console can run GGUF models on its own hardware.
- Apple ML Research: Muse Spark Open with MLX on Mac Studio
Apple's ML research team writes about running an open model with its MLX framework on Mac Studio machines.
- China proposes export controls on 23 AI technologies (including large models, agents & clusters); already open-sourced tech is exempted
China's draft export-control list would restrict 23 AI technologies, including large models, while exempting tech that's already open-sourced.
- Reflection's Beam is freely available on Ollama for a limited time
Ollama is offering Reflection's first open-weight model, Beam, free for a limited time through its cloud service, aimed at coding and agent tasks.
- Meta launches an open-weight AI model that runs on Macs
Meta's new open-weight model was released alongside Apple with a focus on running it directly on Apple silicon Macs.
- Meta and Apple team up to make Muse AI models run better on Macs
Coverage of the Meta and Apple collaboration that tunes the Muse Spark Open model for Apple's MLX framework on Macs.
- Introducing Muse Spark Open: the most capable US open-weight model to date
Meta posted its Muse Spark Open release directly to the local-model community, where users are weighing how well it runs at home.
- nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB · Hugging Face
NVIDIA published downloadable GGUF files for its Nemotron 3.5 Bolt model, sized to fit a single 24GB graphics card.
- New TTS king in town: Fish's Drama 3 35B3A!
Fish released Drama 3, a mixture-of-experts text-to-speech model that a community member reports runs well locally with 4-bit quantization.
- Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta
Hugging Face's walkthrough of Meta's Muse Spark Open, a multimodal mixture-of-experts model with downloadable weights.
- NVIDIA Nemotron Bolt 3.5 74B A9B releases Oct. 15th
Advance notice of NVIDIA's 74B mixture-of-experts model, compressed with 2-bit quantization so it fits in 24GB of memory.
- Show HN: Pulse Local, a Mac budgeting app whose AI models run on your machine
A budgeting app for Mac that keeps its AI features on the user's own computer instead of sending financial data out.
- Run fast, private agents on-device with LFM2.5-24B-A2B
Liquid AI explains how its LFM2.5 model is built to run agent workloads on-device without a cloud connection.
- Run AI agents safely with Ollama and Fly.io
Ollama describes pairing its hosted models with Fly.io sandboxes, a cloud option alongside its usual local setup.
- I'm not paying $20 for ChatGPT or Claude because a free local LLM does
A writer explains why a free model on their own computer replaced a paid chatbot subscription for everyday tasks.
- From the creator of Redis; run LLM locally with ds4
A new tool from Redis creator Salvatore Sanfilippo for running language models on your own machine.
- Ollama now supports Jev-style decision models
Ollama added support for small decision models that return quick structured answers like yes/no or a choice from a list.
- Faster prompt lookup drafting in llama.cpp
A technical write-up on speeding up text generation in llama.cpp by reusing likely continuations found in the prompt.
- Ollaya – Ollama for open-source, Jev-style decision models
An open-source project that packages small decision models so they can be run locally in an Ollama-like way.
- Transformers now runs llama.cpp quants
Hugging Face's Transformers library can now load the compressed model files commonly used with llama.cpp.
- Jun Kim, oMLX creator and maintainer, joins Hugging Face to support the MLX community
The maintainer of oMLX, a tool for running models on Apple silicon, has joined Hugging Face to keep supporting that ecosystem.
- Introducing @huggingface/kernels: 200+ WebGPU Kernels for Local AI
Hugging Face released a library of WebGPU building blocks that let AI models run inside the browser on local hardware.
Learn local AI, one week at a time.
Every Tuesday: what changed in local and private AI, one hands-on thing to try on your own machine, hardware worth knowing about, and a protocol for teams. Plain English, no hype, whoever you are. Short enough to read with your coffee.