Show Scoreboards to specific players without team colours

I am trying to find a way to show a scoreboard (sidebar) to a list of players without using teams and not showing it to everyone. I am making this server in fabric so if there is also a fabric server-side mod that does this for me I would use that aswell.