How can I delete game folders?

Most of the time when I need to install a game through DBI using the PC, I end up dragging the entire folder to the SD Card Install instead of just the files, and when I want to uninstall a game, I do it directly through DBI, but I assume those folders that were dragged from the PC still remain, even though the games' application is deleted in DBI, right? How do I remove these folders so as not to clutter my Switch with unnecessary folders?