How to let my kids own/listen to music albums?

My wife and I both did some google searching last night, and I can't believe there isn't an obvious solution to this.

Our kids are too young for phones. We don't want to introduce the issues (or temptations) that phones will bring. However, may daughter was asked recently what her favorite band was, and she had no idea. It occurred to me, that even though we listen to random playlists all the time, my kids haven't had the experience of playing an album over and over -- or getting "into" a band.

I'm trying to find a way to do that, and it is definitely not easy without a phone. There are some mp3 players out there, but I don't want to pay for individual songs -- and I don't want them to steal music. So ideally, we'd find something that works with a music subscription like spotify or apple music.

The closest thing I've found so far is "The Mighty" -- which syncs to spotify on your phone. The biggest issue I have with it is that it doesn't have a screen, so it operates like a "ipod shuffle." Also it's $109 -- which seems like a lot for a screenless mp3 player.

Any other ideas???

Am I missing something obvious?