O2 sensor replacement on 2010 Camry

I need to replace my O2 sensors and am seeing some wide price differences when searching online. Walmart has one for $40 but when I went to an auto part store I was quoted around $100 each. Would it be a mistake to get the cheaper one? Also, do I need to replace upstream and downstream?