Thinking Machines ships Inkling 2 Mini: a 26B looped MoE with Apache weights, built for 32GB machines
Inkling 2 Mini runs 3.4B active of 26.4B params, loops its middle layers three times, takes 1M tokens and fits a ~20GB checkpoint. Apache 2.0.
Topic · 10 stories
10 stories tagged local-ai on AI Tamer, newest first.
Inkling 2 Mini runs 3.4B active of 26.4B params, loops its middle layers three times, takes 1M tokens and fits a ~20GB checkpoint. Apache 2.0.
Local Code ships its own 2-bit DeepSeek V4.1 Flash, a sandboxed shell, Python and Node, and image tools. The GPL-3.0 source is on GitHub.
Opera One's preview downloads a local model, such as Gemma, that sites and extensions can use for text, classification and embeddings, per-site permission.
A Berkeley-led vector index keeps a pruned graph, not the vectors, so a local RAG index can be a few percent of the data's size. Costs and how to try it.
Block says Dessa is full-duplex, learned from human conversation alone and runs on an M4 Max MacBook Pro. Safety researchers get early access first.
Recursive's Flint is an Apache 2.0 mixture-of-experts coding model for local agents. Its scores are Recursive's own; early testers posted speeds.
NVIDIA's Flare, now Hyperflare, is an Apache-2.0 local inference server for SM120/SM121 GPUs. Python prepares each model; a Rust runtime serves it.
tiny corp's new tinybox starts at $7,000 on tinygrad.org. Buyers pick the platform, memory, storage, and up to four GPUs. Each box is made to order and ships in 1 to 8 weeks.
Microsoft opened pre-orders on 7 October for Surface Laptop Ultra at $2,599.99 and the RTX Spark Dev Box from $5,999.99. Laptop Ultra availability starts 16 October.
A Web Worker can move browser-side computation away from the interface thread. Here is how to send work, return results, and handle the limits.