Mouse who can write?

A book for very young children, about a mouse (or maybe rat) who learns to write. I remember the illustrations showing him using a piece of chalk to write with, possibly in a classroom?