Is thermal paste between the cooler and CPU a must?

I have all my parts but the paste. Does best buy sell paste if it is?