1 year old milk intake

My son recently turned one and the doctor only wants him to have 16oz of milk. We’ve drastically reduced his milk intake over the last week from over 32-40oz to 16oz in hopes that he’ll show more interest in food.

Question: we give him 4oz when he wakes up around 7 and then wait about an hour to try food. He’s not into it at all really and will barely eat. Then around 10 he’ll throw a huge tantrum to have more milk and point at the fridge. We try giving him food he likes at this time but all he wants is more milk. He seems so hungry and idk what to do. Give him more milk or let him get even hungrier in hopes he’ll eat food? Any help is welcomed.