Conversational/listening problems

Ok so to preface I am born to a Turkish father and English mother, I am unfortunately pretty bad at Turkish.

Anyway, I have made quite an effort of learning (I am quite lucky in the fact that I have lots of family to speak with of whom I am very close to, so it’s is more relaxed.) in the last year and would say I can hold some basic conversations.

My problem is, sometimes even if I know what they are saying in terms of the words within the sentence (e.g vocab). It can sometimes just go right through me and taking my time to translate what they are saying in my head. Especially sentence structure etc, especially when I am talking with people who are not my family.

What is the best way of becoming better at this? Just spamming listening exercises?