I Built an LLM Without Attention, and It Made Me Question Everything I Thought I Knew
Last month, I spent three days trying to optimize transformer inference on edge devices. We were getting killed by memory bandwidth, the attention mechanism was just too hungry. Then I stumbled across this QFM experiment, and something clicked. Not because it's a replacement for t...