Hardware
117d agoLlama 2 Inference In 1,500 Bytes Of Assembly
A developer implemented Llama 2 inference using less than 1,500 bytes of x86 assembly. This project, sectorllm, strips away all standard libraries to run the model in a minimal environment. It serves as a technical exercise in extreme optimization.
The Signal
Practitioners can use it to study the absolute minimum requirements for LLM execution.