PxPipe Has Huge Potential for Token Savings

Hi everyone. Not sure if you’ve been following PxPipe recently. In simple terms, it turns the input context into images and sends those images to the model as image input. Since the same content can cost fewer tokens as images than as plain text, this can save a lot of tokens. According to their own tests, they said it can save 60% to 70% of tokens on Fable 5.

The context I prepared was about 76,000 characters. It was basically a very long system prompt plus a bunch of tool definitions, pretty close to the kind of context a real coding agent would send on every turn. After converting it into images with PxPipe, the token count really dropped a lot. Gemini went from 17,402 to 4,051, and Opus went from 23,960 to 5,860. That is around 75% token savings for both.

Then I tested the cache hit rate. Both Gemini and Opus were able to cache the image inputs. Opus was almost 100% on cache hits, while Gemini was around 30%. Once the cache was warm, the savings were still around 75%.

I also tried GPT, but GPT did not work well for this in my tests. One issue is that GPT’s image input token price is higher than reading text directly. Another issue is that GPT does not seem to cache images very well. I could barely get any cache hits, so every time I resent the same input, I had to pay the full price again.

The biggest difference, though, was still how accurately each model could read the image. In my tests, Fable 5 read the images much more accurately than the others. Gemini performed okay. On models that are not as strong at vision, such as Opus 4.8 and 4.7, this approach is also workable, but the stability depends a lot on the model’s vision capability. PxPipe also has a built-in feature that extracts hashes, paths, and similar strings into text and sends them together with the image to reduce errors.

Of course, this method works partly because, for this kind of long context, image input is currently cheaper than sending the same content as text. The accuracy also depends on the model’s capability. Right now, because some models are still limited in vision, this method is not very stable. But I think later this year, once other models catch up in capability, this could become a stable way to save tokens.