Topic

Voice AI

1. I discovered that the biggest latency bottleneck in a naive Voice AI stack is the LLM inference step; moving Gemma 4 31B onto Cerebras’ wafer‑scale engine cut that portion from ~300 ms to < 50 ms, making sub‑second end‑to‑end response feasible. 2. I learned that open‑source …