Thoughts on product engineering, systems design, and building with intention.
At a certain model size, edge AI latency stops scaling linearly and falls off a cliff. I found it, named it, and built a selection matrix around it. Here is what the data showed.
