Some hard is still white after I smoke it?

As the title says, I've been practicing making my own hard. I got it down to where I can definitely feel the difference, but I've noticed some of it stays white after I've smoked through it all? Almost like it was never smoked.

Am I adding too much baking soda? Is this normal? Usually most of it just chars once the oils melt away. (I'm new to this and I cook my own, I know my supply is pretty good so it's gotta be a user error)