How do you recover from counter-jungling?

I feel like whenever I'm jungling and someone on my team decides not to defend blue with us, we get invaded and they get a first blood and they get my blue. If I'm jungling Maokai or Singed, who are both heavily dependent on blue, how would you make a recovery from losing that buff?

For me personally, a solo queue perspective would be ideal, but I'm sure others can benefit from the premade/team perspective.