Tag: cpu-inference
All the articles with the tag "cpu-inference".
-
Kitten-TTS 2 vs Piper on a CPU: local Home Assistant voice
I benchmarked Kitten-TTS 2, Kitten-TTS 0.8 and Piper on CPU at 1 to 28 threads, then wired Kitten into Home Assistant over Wyoming. Real timings.
-
Run Gemma 4 on a mini PC, no GPU required
Gemma 4 26B-A4B runs at usable speeds on CPU-only mini PCs. The RAM math, real community benchmarks, and which mini PC tier fits each model size.