Data Analytics AI agent

I’m building a data analytics agent using the open ai sdk. My agent does a very poor job compared to if i give chatgpt my table names and column names. Do my instructions/ semantic layer just suck? What is the secret saice to building one that reasons as well as chatgpt but also knows my schema?