Fishing spots for a little kid

Hi all, my kid wants me to take her fishing (I have never been myself and am clueless).

Can you recommend some spots (other than the Hudson) that would be good for a beginner to try fishing?

(& Do I need a permit?)

Thank you