Does muscle really build even if you can only do very little reps?

Like say you can only lift a 4lbs dumbbell 10 times before your arm totally gives out and you cannot do it anymore (just an example). If you consistently repeat this 3 times a week, then you will eventually get stronger arms even tho you technically only worked out for like 3 minutes per day? Sounds too good to be true, but I don't know anything about this stuff, so...