"In my book"

What book?!

I know it's a phrase to mean "in my opinion". But saying "in my book" just sounds so self important and self righteous. As if their opinion is somehow holy.