Gadget for Recording Demos

I have Ableton but I cannot (and I've tried! many times!) compose anything I like using it.

When I'm using Ableton, I cannot refrain from diving into every Fx, test timbres / knobs, EQ etc before I even have a verse. It's honestly very frustrating. I either end up having something that is basically some loops and that don't honestly speak to me at all or a bunch of interesting snippets that I give up on after menu diving.

When I'm alone with my guitar, I compose songs that I really like. They speak to me and I feel much more creative, like I'm actually training some creative muscle. I record them using voice-notes so I don't forget the chords and melody, but I lack the ability to experiment with sections.

I am looking for something in between simple voice-notes and a full blown Ableton.

I want a gadget that allows me to record snippets (verse/chorus/bridges/intro/outro etc) using some built-in mic and that allows me to play these snippets in sequence / parallel (basic multi-track). If I can plug-in a guitar/bass, great. If I can't, that's not an issue. I basically want something to help me make a demo, that I can LATER go to Ableton, maybe record everything again and polish it.

So, any FX / EQ or even panning is extra I would prefer NOT to have. I want something to help me have an early demo (structure, lyrics etc) before I decide even on the most basic sound design elements.

Does anything like this exist?