Safety3h ago
Safety
The Gap Between LLMs And Continual Learning
Current LLMs lack the ability to autonomously update weights during deployment, relying instead on static datasets curated by humans. This creates a fundamental divide between fixed-weight models and the dynamic learning seen in human brains. Practitioners must rely on in-context learning to bridge this gap until online learning becomes viable.