Safety
46d agoMIT Develops Non-Generative AI Safety Testing
Researchers at MIT created an evaluation procedure that detects harmful capabilities in generative AI without triggering actual outputs. This method identifies open-source models modified to produce illegal content, such as child sexual abuse material. By bypassing output generation, auditors can flag dangerous weights safely.
The Signal
This provides a critical tool for monitoring open-source model misuse.