How to deal with silverfish?

So, today started raining and I went to my window to close it, and I noticed that when the water started to enter 7 of them jump right out from below the window, I think they might have been eating the wood in my window. Is there anyway I can get rid of them?