Pump Through Insurance (Need Some Advice)

I ordered a breast pump through a medical supply company that stated my insurance covered it at 100% and that they would review with my medical provider. They ended up sending me 2 breast pumps in the mail and almost a month later sent me two separate bills, one for $152 and the other for $22.50. When I went to the order details on their website it still says the grand total is $0.00 and that the order was pending. I contacted my insurance and they said the supply company put in odd code numbers like one being for an ambulance service so I should contact the company myself. The company was no help and just said they'd submit a claim to the billing department and that it's take 30 business days for them to respond which I told them I couldn't wait on because the bills they sent are due within 30 days. I then contacted my insurance AGAIN and apparently I'm not even approved for a breast pump so the supplier should have denied my order or charged me since the beginning.

My question is, am I obligated to pay for it if one was something I never ordered in the first place and the other shouldn't have been shipped in the first place since they didn't have approval from my insurance or my medical provider?

They also tried charging me for milk bags which I didn't even order. On there website it stated as a bonus if my insurance would provide it and that it would be at no cost to me so... why am I being billed for it??

Please help because neither side is helping right now D':