Fire from burners going to high and lighting food on fire

Even on pretty low it’ll do it. Chicken the last two times. Today I only had one burner going and had beans on the side without the flames on and put the chicken in the middle and got away with it cause I didn’t have to cook much. But I’m trying to do large meals. I did replace one of the burner covers with a Walmart one and it seems to just really not do Well. I’ve ordered some more from Amazon a different kind but I’m thinking maybe I need to lift the grates up? What should I lift it up with if that’s the way to go.