Forget the anti-Semites—it’s the idiots we should fear