Why do my Gobilda wheels malfunction when using encoders?

We double checked all our encoder wires and made sure they connected to the corresponding ports. Our teleop and time drives work perfectly fine, and still the wheels aren’t working as we intended when we run with encoders. So when we run the wheels tend to start on low speeds and work it’s way up so it only increases in speeds. Does anyone know what a solution could be?