How do you decide when a repetitive task is worth automating vs just doing it by hand?

I automate one small step of my process last year and it paid for itself fast, but I've also seen people burn a week building a tool for something that only takes 10 minutes a month. Where's your line? Time saved per month, frequency, or something else entirely?