OpenAI GPU wont be idle for long because they have all other requests to serve. Over time there will be a certain % of idle GPUs, amortized across all hundreds of millions of requests they receive.

And idle% is causally connected to whether you make a request or not, surely? I don't understand how your mental model works.