Marshall MAJOR IV don't hold charge even after battery replacement

My headphones are refusing to turning including while being on charge (it's just give me turn on sound and then immediately turning off sound). Even when indicator lights greeen wherewer I'm unplugung them from charge and instantly connect them back indicator starts light red.

I thought that battery just died so I replaced it. Nothing changed at all. Thought that maybe it's was bad connected but again it gives turning on/off sounds on charge.

Any idea what other reason can be there for acting like that?