It's rare that you will be working for that interviewer. Much more likely this is just one of the juniors, one of the team, that you may work "with" but not "for". They still matter, as soft skill, because they will give a thumbs up or down to the boss or to the rest of the committee, and they can make up any reason for it that they want. And do you want the company to offer you the job or not?

But yeah, if you get to interview with the boss and they are a problem for you, then that does matter.

Also you are in a better situation if you get the job offer - they want you -, and let it go because you learned about them - and you don't want them anymore. Get the offer.