Social · Sigmoid #localllama
เปิด speculative decoding ใน LM Studio ให้ local LLM เร็วขึ้น 26% โดย Nokka (นก-กา)
Social from Sigmoid #localllama.
Home Current · September 23, 2026
News in AI
For people running it at home. Self-hosting, local models, videos, Reddit, and social. The Keep refreshes this edition, and doom headlines stay out.
Social · Sigmoid #localllama
Five Ollama Settings You Should Tune Before Running Local Models Seriously By Nokka
Social from Sigmoid #localllama.
Article · Open WebUI
Open WebUI v0.11.4
Added 📉 Far smaller slim image. A slim build now comes down at around 175 MB, near enough 89% smaller than the last release, the local models, the packages around them and the tools that installed them all gone from it; what that changes about the way an instance behaves is set o
Social · Fosstodon #localllama
I am currently having access to an Apple Mac M4 Max with 36GB unified RAM and ohhhh gurl does it do local LLMs!
Social from Fosstodon #localllama.
Social · Fosstodon #localllama
old model: Qwen3.6-35B-A3B-BUDGET-GGUF
Social from Fosstodon #localllama.
Social · Sigmoid #localllama
I get that people here tend to be repulsed by mere mentions of "AI". Now I have to ask you to reconsider. Here's some examples why. What follows is al
l being done with a local AI, a variant of a Qwen3.8-27B model, on a 3090. Short version: with MINUTES of conversation and discussion, I will have a normalized database of all of my cats veterinary records *AND* a pipeline for ingesting those records *AND
Article · ComfyUI
ComfyUI v0.37.0
What's Changed Aimdo 0.5.5 + Auto-detect and enable --fast-disk when the disk is fast (CORE-440) by @rattus128 in
Article · ComfyUI
ComfyUI v0.36.0
What's Changed Add new model blueprints and reorganize subgraph categories by @comfyui-wiki in
Article · text-generation-webui
text-generation-webui v4.9
Changes MTP speculative decoding support : Add draft-mtp as a new --spec-type option. Auto-enabled when loading MTP GGUFs (e.g. Qwen 3.6 MoE MTP builds). Web search improvements : Add snippet support to the web_search tool: results now include a short text excerpt that often answ
Article · text-generation-webui
text-generation-webui v4.8
Changes Redesigned chat composer : Taller input area with the paperclip and message-action buttons pinned t
Reddit · r/LocalLLaMA
MiMo-V3 is getting a new architecture. The core of it, HySparse2, is out today.
Reddit from r/LocalLLaMA.
Reddit · r/LocalLLaMA
this is not even a competition at this point ... this is embarrassing
Reddit from r/LocalLLaMA.
Article · Ollama
Ollama v0.34.4
What's Changed server: fix intermittent "model not found" errors. by @rick-github in
Article · Ollama
Ollama v0.34.3
What's Changed GET /api/show now advertises each model's thinking controls and default: Available in the CLI with: ollama show gemma4
Article · Ollama
Ollama v0.34.3-rc1
server: allow registry cross-host redirects among allowlisted hosts (…
Article · Open WebUI
Open WebUI v0.11.3
Added ♿ Accessibility mode reaches the menus. Accessibility mode now marks the menu entry you are pointing at and the model already chosen with a stronger background, across the dropdown menus, their submenus, and the model picker together with its filter and compare controls, so
Video · Techno Tim
Are Local Models Finally Good Enough?
I have been covering local and self-hosted AI for a few years now - from running models privately at home to what is still running in my homelab today. But to run the larger, more capable models, you need something more specialized than a general-purpose home server with a video
Hacker News · Hacker News
Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama
Article URL:
Video · Techno Tim
What Is an NPU Actually Good For?
What is an NPU actually useful for? Is it faster than a GPU, more efficient, or meant for a completely different kind of AI workload? I tested the Intel NPU in the MINISFORUM MS-03 using Frigate and OpenVINO, comparing the same workload across the CPU, GPU, and NPU. MINISFORUM se
Article · selfh.st
Self-Host Weekly (4 September 2026)
Is "responsible use of generative AI" in the room with us right now?