Stable-baselines-3 workers
I'm investigating the implementation of some algorithms of the stable-baselines3 library.
Specifically, I see that the documentation of some algorithms (A2C, PPO) mentions that the implementation uses multiple workers.
For the other algorithms, it doesn't say anything about it, so my question is:
Can I assume the other algorithms use only one learner?
To give more context over my doubts, in the summary table of all the algorithms it's shown that each of them supports "multi processing". But, if I understood correctly, that only refers to using vectorized environments, although I wouldn't bet on it.
Final note: I tried answering answering my question looking at the code of A2C (which mentions using workers) and SAC (which doesn't mention workers) but that didn't help, so here I am
Posted Jul 29, 2024, 7:27 AM UTC