I'd say removing the interstate from the Embarcadero and Hayes Valley is a substantial improvement, but your point still stands. That was politically unpopular and required a major earthquake.
In demographic and vibe, sure, but the built environment is very much the same. The city was even _downzoned_ in 1978 [1] to keep single family homes at the end of their life from being demolished and rebuilt into denser apartments: 76% of the city would be rezoned as single family home only.
It’s long been coasting off its past success.