What's missing from the open-source AI infrastructure ecosystem?

Running everything in the cloud is expensive.

Running everything locally limits capability.

Do you think the future is hybrid AI where requests dynamically move between local devices and cloud GPUs?