Orc Raids

Is it just me, or do the orc raids only attack at night? I am getting sick and tired of having to fight off waves when I can't even see what I'm supposed to be fighting