NYC - Trying to get out of a Lease that I just signed question

Location: NYC

Greetings! I'll try and keep this rather simple but I was in a huge housing crisis due to someone offering a room that I had to someone else so I went looking for a new apartment or room that I had to secure in a matter of hours. Moved in on Sunday, March 1st and it's been a nightmare since.

Issues with the apartment: Closet wall is completely black from mold/mildew (part of this was hidden when I did the tour); Landlord has removed all the smoke alarms in the apartment except in their bedroom, on the ground floor and windows have no locks, only way to turn off the shower is to turn off the water to entire apartment. Plus the day I moved in the landlord roommate unleashed a barrage of verbal assaults at me that left me in tears.

Lease issues: I did sign a 4 month trial lease. I let the landlord/roommate know on the first day I was there that I was uncomfortable and I didn't think this would work but officially did not ask to leave until the next day the 2nd. Lease has no mention of early termination but does have a provision for administration fees for violations. Rent is $1550 with a $1550 security deposit. Total of $3100. However this is where the issue comes up. When I tried to originally Zelle them my bank said you can only send $2000 at once so I sent that and was planning on sending the $1100 the next day. Because of the issues I have found I haven't paid the remaining $1100 yet.

Question: What are my options to leave without a huge legal battle? The landlord wants me to forfeit the ENTIRE $3100 (both rent and security deposit) to sign a agreement to let me out of the lease and of course send them the remaining $1100. I really don't feel like eating $3100 for staying 3 days in an apartment with severe mold issues, no fire alarms and no locks on windows. Do I have any right to push back? I am worried if he tries to evict me but I am packing up my things and moving out tomorrow morning. But I don't want along drawn out legal process. I am assuming the $2000 is just gone at this point which i'm kinda OK to eat but not $3100.