HP is particularly special because of all the ships from Pacific nuclear tests being taken there to be cleaned, which mostly consisted of spraying them with water (left to drain on-site). So in addition to chemical contamination from Navy facilities of the era (PCBs, particularly), there are various radioisotopes.
Yup, cleaning up HP will be expensive. But isn't that a perfect case for an economic stimulus project? Invest now to create an asset that will improve economic productivity for the following century.
The fact is that HP will one day be a gorgeous place to live and watch the sun rise over the bay. The question is whether that's a 100 years from now, or whether we start on it now, so we can see the benefits in our life times.