I’ve heard you can learn a language just by listening, but how do I get to the point where I can start doing that?

I’ve seen a few YouTube videos and read some articles about that, but I don’t know how effective it is, since I’ve only learned languages from teachers. I want to learn Japanese on my own, so how can I get to the point where I can try active listening? And do you recommend it?