Why is working a job easier than being self employed?

I feel like it should be much easier setting your own hours and doing your own thing. Is it because it's more mental than anything?