How do I setup a multi agent infrastructure on my PC?

I am currently running a project on Claude and GPT to compare the performance and limitations.

The Project - I have an idea, bring it to AI and get interviewed about it to clarify and go into detail. After concluding I get a project overview and core specialist roles which are "deployed" within the project to work on different tasks.

So a basic idea to project pipeline. So far I prefer Claude output over GPT but the usage limits on Claude Opus are hit in every cycle which is pretty frustrating.

I've never hosted locally but given I'm sitting on a 4090 just for gaming right now, I would like to give it a try.

I basically want 4-6 Agents that each have very specific instructions how to operate with a distributing agent that handles input and forwards to the respective agent.

I'm not sure if they need to be running 24/7 or can be called when a task is forwarded to it to save compute. I also don't know where to look at model comparisons, what would be the best fit for this and how to install. I'll appreciate any direction I can get!