I Can't Demolish my shed

So I have been doing some reorganising of my farm and I want go demolish this shed. It is completely empty. Everytime I try to demolish it, it is just red and won't let me select it. I don't understand what I'm doing wrong.