Model
101d agoNew LLM Architectures Slash Long-Context Costs
KV sharing and compressed attention mechanisms now define the latest open-weight releases. Gemma 4 and DeepSeek V4 employ these techniques to reduce memory overhead during inference. This shift lowers the compute barrier for processing massive documents.
The Signal
Developers can now deploy longer context windows on existing hardware without linear cost increases.