Has anyone tried using magnets to hold armor to a under suit?

Still in the planning phase for my first cosplay suit and I'm exploring a bunch of options and I had this thought today. Just curious how feasible it would be or if there's a major downside I'm missing? Not so much the chest but maybe like the fore arm armor to keep them in place, maybe the calf armor?