Help being overrun by pests!

I brought all my plants inside for the winter and now I’m just watching as they’re getting eaten alive by black, green, and red aphids as well as big fat inchworms! I’ve been putting the caterpillars in a container and feeding them sucker branches from my tomato plants and I’ve been mechanically, removing aphids and putting them in a container with ladybugs. It’s getting to be too much though, and I’m not sure what to do. The biggest issue is is a lot of my plants are used to feed my other pets like my giant African Millipede, snail, or pill bugs. I cannot have any product that could harm my pet bugs on their food that’s why I started growing their food myself (I’ve dealt with the horror of watching one of my favorite pet bugs slowly die because I bought non-organic greens). So here’s the overarching question, how do I get the bugs off of the plants that are meant to be food for my pet bugs?