The Energy density of capacitors is very low (10-100x less than lithium) and they cost quite a bit more per watt-hour.

Capacitors are good if you need power for seconds rather than the minutes-hours that batteries are good at.