r/RockchipNPU•
swdee

RK3566, RK3576, and RK3588 compared

Just over one year ago I created go-rknnlite, a set of bindings for the Go programming language to make use of Rockchips rknn-toolkit2 for running Computer Vision inference models (classification, object detection, segmentation etc) on the RK3588 NPU.

With the recent release of Radxa's Rock 4D which features the RK3576, I added support for it and other models in the RK35xx series.

Whilst the RK3576 is a 6 TOPS NPU, its configured as two cores, versus the three core layout in the RK3588. The RK356x series are only a single core at 1 TOPS. The following graph shows the average per frame inference time for these models.

https://preview.redd.it/nho89e6jpm6f1.png?width=1979&format=png&auto=webp&s=4aadf2bb8d24a7a3c01d9e3959e3e9501a68b914

Overall the RK3576's NPU is comparable, sometimes it performs a bit faster due to the Rock 4D having faster DDR5 memory. However for models that have a lot of CPU post processing (Segmentation Models) these perform slower as the CPU cores are much slower than those in the RK3588.

Posted Jun 13, 2025, 5:20 AM UTC

165

Comments aren't archived yet

This post had 5 comments on Reddit. Comments for this period haven't been loaded into the archive yet.