Please help, I am confused.

Please help, I am trying to understand Reddit.

Let’s say I am new and currently have 100 karma.

Every day, I get 10 upvotes on a new daily post I make.

However, I also have one unpopular post that receives 10 downvotes every day., and that carries on for a long time. The visible score of that post is already at 0, so it can’t go any lower on the site.

My question is:

Do those daily downvotes on the unpopular post still slow down my overall growth of karma, even though the post’s score is already at 0?