Advice on Token Usage Needed

NSFWQuestion

Hi, I’m currently having an issue with my token usage. I’m averaging more than 10,000 tokens per request and I just started using an official API key two days ago. The first request I put in around ended up using 12k tokens which I didn’t understand. I’ve burned through 55 cents already when i haven’t even hit 200 requests.

My context window is set at 12.5K. My advanced prompt is around 850 tokens. I’m currently using two bots right now, one with 1772 character tokens and 5 lorebooks (heavy, i know), and the other with 3716 tokens and a chat memory of 800 tokens. The only bot i used yesterday was the latter, with 73 requests, averaging to around 12k tokens. Bot responses are typically around 4-5 small paragraphs.

The cache misses slightly exceed the cache hits which may be the main issue. I just don’t know how to solve it. Is there a way I can limit such high token usage when the bot sends messages?

Posted Jun 12, 2026, 8:09 PM UTC

17
Loading comments…