It's very rare that you'll be at the exact point where it does make sense to use the "not quite high-power GPU racks".
* Lowest short term costs favors "just use the Cloud" solutions, that will often have power, HVAC and space constraints that favors new GPUs.
* Lowest long term costs bias the cost analysis to OPEX, where old GPUs gets expensive very fast, as they use more power, HVAC and space for less compute.
* Lowest short term costs favors "just use the Cloud" solutions, that will often have power, HVAC and space constraints that favors new GPUs.
* Lowest long term costs bias the cost analysis to OPEX, where old GPUs gets expensive very fast, as they use more power, HVAC and space for less compute.