Should I be avoiding milk?

My liver enzymes are recovering but I’m struggling to put on weight as I’m slim as it is.
I want to add semi-skimmed milk but I know that the sugar in it is lactose. Would this be bad for my liver?