Extremely slow internet when pc is connected with ethernet to my router

My pc has really slow internet when I plug it with the ethernet calbe in the router. When i plug my pc with an ethernet cable in the modem, it is 4 to 7 times faster.

I still want to use the router for devices upstairs but it really ruins the internet on my pc.

I got the linksys e5400

Hopefully someone could help me