Rotating building features

I was trying to extend the foundation of the house and I found that the rotation is only in diagonals? I can't figure out how to make everything line up well. Then I accidentally deleted a wall and ran into the same problem! (I just clicked don't save so crisis averted for that) Am I missing something on how to rotate foundation/building of house?