huge memory usage with pdfs

It doesn't matter what pdf app I'm using (Preview, Skim, Mendeley), but have a few pdfs open results in massive memory usage (several gigs). Does anyone have this problem?

I'm using El Capitan