Le Crop

I ordered Le Crop mottled ecru in my usual US 4 (36) and they were zipable but very tight so I sent them back. I reordered US 6 (38) and they are quite big, gaping at the back of the waist and a tad big in the hips. While the 6 feels comfortable, I am concerned that I will be constantly pulling them up (the only saving grace is that the stiff material gives it structure). But also with the super high waist, I’m concerned that the 4 may not be comfortable when moving and sitting. Now I wish I still had the 4 to compare, maybe I was too quick to dismiss them. I am wondering if the 4 would stretch and give a bit after wearing for a few hours? And finally, I am 5’4 with short legs, they are not remotely cropped on me. Has anyone had luck with having them hemmed and the edge still looking good?