It’s called pedigree collapse. Your family tree grows exponentially to the second power with each generation. So a mere 50 generations ago, which is to say roughly 1000-1500 years ago, you had 1,125,899,906,842,624 slots in your family tree. Needless to say the vast majority of those slots don't have a unique person in them.