How to identify if another website is doing seo?

So I was doing some competition benchmarking. There are some websites which are ranking way too higher than expected for some competitive keywords. I was infering these guys don't have that much too spend on seo. But looks like I am wrong. Are there some fool proof checks I can do to identify whether they have an ongoing seo agency or inhouse.