(Before I say my question, I just want to say that English is not my native language, it's French, so execuse myself if what I say is not to understandable)  
So I have an issue with my animation in Blender, I have an animaiton where my avatar try to repear a task with an hammer, and at some point he drop the hammer because he is shocked by a thing that I say (it's for a video that I make if it can help), but the thing is that when I use Rigid Body Physics for the fall of the hammer, it always make the hammer rotate when the animated option is turned off

I have tried to put the Hammer (who by the way is a model from Smash Bros that come with two mesh that I have joint with Ctrl + J with the Head part as the "parent" (I don't know how to say it)) in an empty where the empty do the animation part and follow the avatar, and the hammer mesh only have the rigid body part, but it doesn't change anything, the hammer still rotate, for the origine, it's in the center of the hammer head for both.

The Collision shape of the Hammer is in mesh and for the task, and the ground is a box, and the avatar doesn't have collsion

For the parent thing the hammer is directly a child of the empty, I tried with a constraint and it does the same thing

Issue when I use Rigid Body Physics with an Animation where the Object Rotate when Animated is Off