you need to qualify that with “that is actually available”. :-). A100s I hear are harder to get in bulk. But I have modest needs!
I have been using modal and vast. Vast is cheaper. Modal has some a free inclusions of $30 but that is probably $8 to get the same power in Vast. Modal resell AWS/GCP at the moment. GCP direct seems cheap enough. As does Lambda labs.
With vast some machines don’t start, so you just need to bin them and try another. For learning and non private this is acceptable. For serious stuff I think Vast lets you filter for data-centre GPUs. Modal tends to just work and lets you store the model for later more easily.
Overall: just go with vast. You boot it up and run SSH. It is a familiar experience. Very little time needed on RTFM stuff!
