I think the key to it is using the listening rooms that hi fi shops often offer, and being honest with oneself about whether the impact is really tangible or not.

Be a while before I can justify even contemplating that sort of hifi spend anyway so I shall proceed in blissful ignorance for now :-)