Toddler Snack Fiasco

I recently attended a play date with my toddler and several other toddlers, all aged 15-16 months. One mom handed out small puff snacks. My son ate his, and then another one of the kids handed hers to him. He took it and started eating it. I apologized, and the mom told me not to worry about since her daughter wasn't interested. A few minutes later, when it was 3/4 gone, her daughter reached for it and my son pulled away. The mom asked if the daughter could have it back. Given the exchange a few minutes before, I apologized again but wasn't willing to take food away from my son. I brought snacks, too, that I shared with everyone. But I can't stop thinking about this and wondering if I did the wrong thing. Thoughts?