If microwaving food is the most energy efficient way to heat it, then why don't we use microwaves to heat homes?

Besides the obvious safety issues, is it conceivable that at some scale or climate, using microwaves is a less costly alternative to heating a building?