Time travel annoys me. Will I hate the show?

I can't get past the time travel element. Will it get better and "hook" me soon, or shall I move on?