Missed opportunity with the evil doctor?

When they reveal the evil doctor who steals quirks was Deku’s doctor who diagnosed him as quirkless, I for sure thought there would be some reveal that the doctor stole Deku’s quirk, making him quirkless. But then there was never that linkage made.. am I the only one?