Help understanding ezpass in NJ and NY

We live in New Jersey but we drive in to New York every now and then. We also signed up for EZPASS in New York and NEW JERSEY and so we have two transponders for the car. Questions:

1. Should we keep both in the car?

2. Can they be kept in the glove compartment or must they be mounted to the windshield?