GPT-OSS formatting when running locally.

Discussion

When I run gpt-oss locally, I get all these tokens in the output.

<|channel|>analysis<|message|>User says hello again. Perhaps they want to start a conversation. I can respond with greeting and ask how I can help.<|end|>Hi there! How can I help you today?

I have tried with and without --jinja w/ localcpp, but it is always messed up.

If I used an API with the same model, it's always handled perfectly.

I thought it was the software not properly handling harmony grammar properly but now I am not sure since other sources with same model work fine.

Posted Oct 6, 2025, 7:17 PM UTC

26
Loading comments…