Can you play with just starter decks?

My husband and I are just learning how to play MTG. We have just got the Assassins Creed starter kit and are planning to get the Final Fantasy one or LOTR ones in the future.

We keep seeing commander decks but it seems to be for 4 players only. We are still learning so artifacts/equipments are still a bit fuzzy. Would it be a waste to keep buying starter decks or do yous have other recommendations?