What to do during office hours

Im an incoming first year college student and I keep getting advice to go to office hours and "build a relationship with your professor"

But what does that even mean? Do i go every single time? What if I dont have any questions? ​If I do have questions, what am I supposed to do afterwards? How do I even try to relate and hold a conversation with a professor?