I presume it's an observation, not advice. That often those who are called exceptional have some skeletons in their closest. That there are more statues of Jefferson Davis than Harriet Tubman.
I read it as a warning. Life is full of tradeoffs, to be extraordinary in one area requires you to neglect or ignore other aspects of life. In the end people will be hurt.
I wonder what he meant by that.