GPT-OSS formatting when running locally.
When I run gpt-oss locally, I get all these tokens in the output.
<|channel|>analysis<|message|>User says hello again. Perhaps they want to start a conversation. I can respond with greeting and ask how I can help.<|end|>Hi there! How can I help you today?
I have tried with and without --jinja w/ localcpp, but it is always messed up.
If I used an API with the same model, it's always handled perfectly.
I thought it was the software not properly handling harmony grammar properly but now I am not sure since other sources with same model work fine.
Posted Oct 6, 2025, 7:17 PM UTC
26