Research
151d agoSelective Gradient Projection Tackles Forgetting
A new study introduces SFAO, a technique that uses cosine‑based gating to keep neural networks from erasing earlier knowledge when learning new tasks. By projecting gradients selectively, the method balances plasticity and stability while cutting memory usage.
The Signal
The approach promises more reliable AI systems in ever‑changing environments across worldwide environments continually.