Is it possible to get used to living near a Trainline?

My husband and I are trying to remain in Didsbury, Manchester. But the only affordable housing we’ve seen seems to be on a Trainline. As in our house/garden would back onto the Trainline. Is this something we would eventually get used to?

For some context; my husband sometimes works night shifts. And we have a baby, with another (hopefully) planned later down the line. Is this manageable? What about in the summer with windows open?

Trains run 10-20 mins during busy periods. The carriages are generally pretty small and the train goes past at fast speed for about 5 seconds each time. Is it worth the risk?

Any help or opinions would be much appreciated!