am i (21f) being toxic to my bf (20m)?

my (f21) boyfriend (m20) wants to go out with his 30-something lady friend who happens to be a sexual worker just by themselves (they have known each other for more than 2 years) and i dont feel comfortable at all with it. he told me that i am being toxic and that he has already lost a lot of friends bcs of me. he used to go out a lot at night in the beginning of our relationship and i didnt like it so he stopped, and he stopped talking as much with his group of friends, although he still talks to some of them. i feel super uncomfortable and told him i dont want him to go, but he told me he is still going, that he isnt losing any more of his friends bcs of me, and i dont know what to do. i have caught him watching porn and lying to me multiple times so i feel even worse about it bcs of it. please help me, am i being toxic?