I think danharaj's point was that the effects of sex-linked variance -- regardless of how big they are -- have not been shown to be meaningful compared to the other factors that affect human society. However, it gives the illusion of scientific rigor to use observable sex-linked variances to explain our social condition; in reality there are many possible alternative explanations that are never addressed, and many confounding variables that aren't controlled.
Who claims that? Not me. I just want to know if sex differences exist, where they come from, and how big they are.