r/vyos•
0nn0

Is using VyOS for a 10 GbE L3 router a viable option

I'm wondering if it's a realistic option to build a router using VyOS as the OS to create a router which could route traffic at high speed (preferably 10Gbps, but at least 7Gbps+) between my 10GbE subnets on my internal network.

Internet traffic would be handled by a different machine. It's just for the inter-VLAN traffic.

What kind of hardware would this require?

Posted Mar 27, 2019, 9:14 PM UTC · edited

49
_kroy•

Doesn't take much, as long as you are just talking strict routing. All my routers are just 2 vCPU instances, and they handle 20-30Gb with ease.

3
0nn0OP•

How much RAM does it take?

1
_kroy•

When it's not memory leaking (it was for a while), all my instances run a single gigabyte and that's probably overkill.

2
winkmichael•

CPU bottleneck is your only issue here, and the issue is compounded by the fact that the kernel network stack does not span cores so in effect the networking is done by one core. You will be able to handle 10 gbps with normal sized packets but if you end up with a great deal of small and fragmented packets you will start to experience lag, loss and resets. In short, this is cool but if anyone tries to DDOS you or anything like that you are toast.

2
0nn0OP•

Normal sized, as in packets with an MTU of 1500? I guess larger is better here? (I'm not entirely sure, some people assume 9k these days)

1
winkmichael•

With all due respect, based on that follow up question I suggest you do considerable research if you expect this to be a production system. You can pretty safely assume anything over the internet is no larger than 1500. Jumbo packets might exist on the LAN but they are not passing beyond your house or office.

1
0nn0OP•

I'm talking about inter-VLAN in my home lab. Maybe I should have made that clear earlier. Sorry.

But you're right about the research. This question is part of my exploration into the topic, so I can judge whether it's a viable option.

1
winkmichael•

If this is for your home lab, you are all set and will have no performance issues. If you are strictly doing vlan stuff you might just want to look at the vlan docs for linux as they are pretty simple - no need for overkill with vyos

1