pcos but not many symptoms? help

I'm 26 years old and was "diagnosed" with pcos when I was 20 because I had 5/12 periods that year. Doc did literally no other tests and I don't struggle with any other common symptoms. So I just assumed I probably didn't have it and went on the pill (which was the purpose of my appointment).

My husband and I have been TTC for 6mos and no luck and no periods that whole time. I went back to the doc and they said my labs point towards PCOS so I'm going back for an ultrasound soon.

Just wondering if this is similar for anyone else and any advice? I am 5"4 105lbs and i don't struggle with acne, weight, or bad periods. I hardly get periods and when I do they are ok. I don't struggle with fatigue or body hair or really anything else I read or hear about.

It seems my only symptom is literally just not ovulating. Wondering if they are even right about my diagnosis. TIA <3