People have such stark opinions about me, it's hard to know where I stand

Basically, I have gone most of my life not knowing I had ADHD and was diagnosed (late 20s, M) last September and medicated for it.

I don't know if anyone else gets this, but people seem to have quite stark opinions on my functioning or just who I am as a person.

Throughout primary school, I was placed into a learning support class (found it boring, low skills, and I was very disengaged), then my Year 3 teacher did not agree and took me out. Then at secondary school, I ended up in all bottom sets. I then got on really well with my science teacher as she taught in a way I liked, so I moved up sets. Then moved up sets in English. Then, by mid-Year 8, it all went wrong as I didn't get on with the teaching style of those teachers, lost all confidence, and basically failed school and ended up in bottom sets thereafter.

When learning to swim, no one could seem to teach me and engage my brain. I did get on with 1 swimming teacher who was a bit more edgy (spoke her mind, had a very interactive and passionate teaching style). She got fired for swearing at my old primary head teacher in the playground because she told him he was terrible basically (which he was). My working-class parents managed to afford 1 private lesson with her outside school, and she taught me to swim in 1 session.

I didn't get into sixth form but ended up on some access course. I would say that teacher was a bit edgy and wouldn't always follow the rules. She once announced to the classroom that I would one day have lots of money, be in business and have a big house.

So I did end up doing my own thing. Had points where it didn't go well, but the burnout always came to ruin me every time. Then a massive burnout led to this diagnosis and meds.

So ended up on UC. They basically put me with a health work coach as they were so concerned about how burnt out I was and recommended I apply for PIP / LCWRA. So I did that; they basically gave the impression you're taking the mick and 0 points all round.

It honestly feels like I'm some kind of fraud at times, and it's hard to understand what my long-term function is. Does anyone else get this issue of others having such black-and-white opinions of them?