Help wanted

My friend and I haven't been able to get mods to load when one of us is hosting from the game, we both have all mods installed and have them in our server mods as well, but they still don't work, the mods will show up, but if you select them they aren't loaded into the game. Only one of us would be able to use them, does anyone know a fix?