A maybe idea to tackle the housing crisis?

So this is in no way a complete idea as even I can see a few holes in this plan. But I think this idea is at least worth a discussion. Just a little context we all know about 50 or 60 years ago. The average salary was about 5 or 6 thousand a year and the average house about 18k or so, or in other words about 3 time annual salary. Very doable even by today standards, if houses were only 3 times the average wage.

So how about if you currently own zero houses you are able to buy a house for say 3 times the average salary. Now I know things like the cost of the house, land it is on could affect these prices so on. But for right now just concentrate on the broad idea and the details can come later. The money that the government will need to pay for this can come from those who own more then one house. To be fair the more you own the bigger you will pay for owning more. So if you own 1 or 2 extra houses after the main one you live in, things shouldn't be to bad. I'm not sure how the taxing of this will work, but ideas for later. The point is those that own portfolios of houses will be hit the hardest, this will hopefully force them to sell off access houses that are collecting dust and put more on the market driving down prices.

As I said above there are holes in this plan, for example what is to stop a married couple from both saying they don't own a home and getting 2 houses instead of one. Well stamp that crap out, same for I own houses under a company. Do some homework and if you own houses through a company you own them end of story.

I'm not looking to argue over small details here. I want to gauge if you think the broad idea is viable before I jump down this rabbit hole and really look into the details about this.

As for those who object to this idea. Mainly those that own more then one house. Tough. Shelter is a human right along with things like water and food, not something for you to make a profit on.

Now just a few more notes. I'm not looking to stir up trouble with political debate and so on. I'm just a bloke who talked to a few other blokes and this was the result and I'm curios enough to post the idea here to see what you'll think on it. Don't sweat the details and let me know if you think the general idea has merit or should be tossed in the dump and why.