Did I scare him away?

I'm a virgo f having a somewhat casual thing with a Scorpio man. We've been seeing each other for almost 2 years now but have kept it extremely casual with almost no texting unless we're planning to meet up for sex. Recently, I've felt things were getting more intimate and heading towards something slightly more serious. He told me how he wants his relationship dynamic to be in the future. In the past, we only met up when he came to my state for business, and it was strictly sex (never went out on dates or went deeper to get to know each other). But then he invited me to stay a couple days at his place and we spent the day shopping, helping him decorate his new place, had a movie date, he got me some gifts, and I even bought him some stuff for his home to show my appreciation. Overall, we just had a nice flow of conversation and I realized I really like him a lot. He told me he appreciates me a lot and he didn't want to wait a whole 2 months to see me again (our usual timeline). I've felt confused because I didn't want to get my hopes up that something is brewing when it's not. I'm okay with casual, but not if we're going to be growing closer. I would rather stay detached and not know him that well if he isn't going to take me seriously.

Now, it's been 3 weeks since I last saw him and he was supposed to come down today and we had plans to meet up. At first I was really excited to see him because we always have fun together, but he has this fantasy of a threesome that he continues to bring up in a teasing way. At first I told him I would never do that as I get too jealous, but he ends up convincing me that a throuple (him having 2 gfs) sounds like fun. I told him I could only see myself doing that after I truly trust someone and have built a strong relationship with them. He seemed to understand but ever since I showed a slight interest in it, he brings it up all the time. It's hard for me to be excited to see him when he says he misses me so much, but is also asking me to "bring a friend". It was starting to make me feel like I wasn't enough for him and I just feel like I just wanna have fun and not have other things in the back of my mind. On Friday night, I end up texting him my feelings and I tried not to sound like I was putting blame on him for hurting my feelings, I moreso just wanted him to know that his teasing was bothering me. He never responded and it is now Monday morning. He told me he would try to come down Sunday night for a sleepover or Monday (today) to spend the day together. He also either blocked me on insta, or deactivated his account, I can't tell. The last time I tried to tell him how I felt about being flaked on, he didn't respond to my text and then texted me 3 months later, still disregarding the text where I was basically cutting him off for flaking on our plans and making me feel disrespected. Honestly this ended up resulting in some of the best sex and we both kind of detached from each other and kept it strictly sex up until now.

I feel like I'm being disrespected again by being ignored and flaked on... I'm not going to text him again but I get the feeling that he will just wait a couple months and hope I forgive him like I did the last time. He seems to ignore my vulnerability which hurts a lot because it took me a while to feel comfortable around him again after the first time I tried expressing my feelings and got shut down. Is it possible that I hurt his feelings/made him feel bad, or could it just be that he cares that little of me that he doesn't want to talk to me unless there is 0 conflict and vulnerability. I think I have a tendency to make things more serious than they are and I could potentially see how my message came out of the blue for him. I would hate to never see him again but I want to stand up for myself and not let him walk all over me...I would rather just go back to how things were and not do any extra stuff that couples usually do if it isn't going to go anywhere.