When websites, especially AI powered ones, have a waiting in queue for free tier....

Is there genuinely a queue of low priority requests waiting in a slower queue that saves them infrastructure costs, or is it just an artificially created wait?