How not to be a bard anymore

A guard called me a Bard. This is probably because I did the bard college quest in Solitude a while back. But for some reason being called a bard feels insulting. Its like someone calling you a clown or jester. If I use console command, and undo the "Tending the Flames" quest, will that also stop the game from seeing me as a bard?

Thanks in advance for responding.