I lost Lydia.

I remember exploring a cave when I lost her. She was getting annoying so I threw down a cliff but I saw her get back up and continue to follow me. A little while later, after I left the cave I noticed she was gone. I've checked all my houses and Dragonsreach for her and no luck. Any suggestions?