You don't train GPT-3+ models or serve millions of users off Amazon spot instances, that's for sure! And whatever arrangement they have is likely transferrable or salable.
Yeah I’m aware I just didn’t know if they had something in house or leased from an HPC provider (not spot instances - although honestly that sort of thing wouldn’t surprise me from some other company like Stability).
