[TOMT] [Movie] Maybe Igby Goes Down?

Trying to remember this indie coming of age film, I think it was made early 2000. Only scene I remember is the boy wants to have sex so his brother/dad takes him to this underground brothel. The brother/dad walks outside but then changes his mind and runs back in and grabs the boy.

I thought it was Igby Goes Down but reading through the lot, it doesn’t seem to match.