Applied for an EA role and got passed for being too polished

As the title says, I interviewed for an EA role at a very small office but they have global presence. The interview was very casual and the panelists (3) were eating lunch while interviewing me (in hindsight, this was a red flag). Got feedback from recruiter that I came off very polished, articulate, and smart but that they are worried I may not be a good culture fit as their environment is crass and scrappy. Guess I dodged a bullet