Run FLUX.1 losslessly on a GPU with 20GB VRAM

Tutorial - Guide

We released losslessly compressed versions of the 12B FLUX.1-dev and FLUX.1-schnell models using DFloat11 — a lossless compression method that uses entropy coding on BFloat16 weights to reduce model size by ~30% without changing outputs.

This brings the models down from 24GB to ~16.3GB, allowing them to run on a single GPU with less than 20GB of VRAM, with only a few seconds of extra overhead per image. • Compressed FLUX.1-dev: https://huggingface.co/DFloat11/FLUX.1-dev-DF11 • Compressed FLUX.1-schnell: https://huggingface.co/DFloat11/FLUX.1-schnell-DF11 • Example code: https://github.com/LeanModels/DFloat11/tree/master/examples/flux.1 • Paper: https://arxiv.org/abs/2504.11651

Feedback welcome — let me know if you try them out or run into any issues!

Posted May 7, 2025, 2:39 PM UTC

29893
Loading comments…