Picture book about a castle

This book was probably published in the 70s or 80s. The binding was light gray. It’s about a guy going through the rooms of a castle and he ends up in the top of a tower and meets a man (maybe an old man or a wizard).