How to Compare Two Large MD5 Hash Files for Duplicates

Hello all,

I need to scrub two MD5 hash .txt files against each other to find duplicates. This will be to isolate any emails that overlap between the two files, so that they can be suppressed.

In one file, I have a column of emails and a second column of those emails MD5 hashed, that was downloaded from our user database. In the 2nd .txt file, I have one column of just MD5 Hashes, without the original emails, downloaded from elsewhere.

Both of these files have about 14 million rows in them. I have tried using autopilot and excel, but they both have appeared to struggle with the large amount of rows.

Do any of you have a recommendation on how you would tackle this issue with common software? The catch is, this is for government work, and I'm not allowed to just download any third party program unless it goes under a long review, so well known pre-installed products would be preferred if possible.

Thank you so much for your help!