PC Upgrade for RSS

My RSS performance really isn't what I'd like it to be. I get pretty poor fps, around 20-30 in flight most of the time I believe. What's worse are the loading times, which are unbearably long sometimes. I'm running the game on an SSD, and I have a Ryzen 5 2600, RX 5700 XT, and 16 GB of DDR4-3200 RAM. I don't think my GPU is a problem so would it be better to get a new CPU or get more RAM?