Custos

I'm building Custos!

A blazingly-fast, kernel-bypass gRPC firewall. Protects AI inference backends from binary exploits and GPU-starvation DoS attacks at the packet layer, before they even hit the container.

Looking for any feed back on the project. Here is a quick demo: https://drive.google.com/file/d/1nPvDvTqKmOrjZG5MiDg4oWiMSl4LznIC/view?usp=drive_link

Here's the Github: https://github.com/val-27/Custos

This isn't a paid service and will be totally open source under the MIT license. What can be improved? What gaps should I be looking to fill? Is this a real problem that needs to be solved? Any feedback would be highly appreciated.