Is anyone else finding it hard to use the memory mechanic ?

I can never get the memory to activate. I see the ppl I have my lantern out but it never learns the memory so I can actually watch it. It’s like super specific where you stand. Which I don’t understand. As long as you’re pointing at the memory that’s all that should be relevant. Anyone having issues ?