Good idea to buy points?

700k mortgage

5.7 with 1,500 lender credit or 5.5 for 6,000

Plan to keep the house for a while, but not sure if I should buy points not or take the credit and refinance in a while, assuming rates go down.