Loan via credit union in NC

I am in the market to buy a used 2024 Hyundai Palisade. I've read that you can obtain much lower interest rate loans at a credit union compared to financing through the dealership or a traditional bank (4.5 vs 8.8%?!) I'm not a member at one and do not have any affiliation with a state employee or anyone in the Military. Is it still possible to apply at a credit union. I have excellent credit if that helps. Looking for best option in NC!