Safety
99d agoCritique of Counting Arguments in AI Risk
Counting arguments assume AI goals land randomly in a vast space where survival-compatible outcomes are rare. This logic suggests AI doom is probable because harmful goals outnumber helpful ones. Critics argue this approach provides no actual evidence for risk.
The Signal
Practitioners should treat these probabilistic guesses as speculative rather than technical proofs of x-risk.