Removed barn door, how do I patch this up if spackle is only for tiny holes?

Ive left it for a while and really want to handle this, I just spackled nail holes, but not sure how to handle this. The Home Depot door installer guy said it looked like the builder super glued the wood barn door track on here, so he ripped it right off and left it like this. Im very much a newbie at house stuff! Advice is very welcome thank you.
https://imgur.com/a/utQC4uF