best difficulty

i just beat elden ring +dlc with no summons or magic and im looking for simular difficulty in this game.should i chose legend or expert and what is the downside of chosing legend??