Carbon, open source DNA model, 250x faster than Evo2-7B and runs on llama.cpp

Hugging Face just released Carbon, an open source model trained on DNA. You paste a sequence and it continues it, predicts the impact of genetic mutations and generates the corresponding protein 3D structure.

What surprised me is that the 3B checkpoint is on par with Evo2-7B on benchmarks but runs 250x faster. They basically took everything that works in modern LLMs and applied it to genomics.

GGUF weights are already out so you can run it locally via llama.cpp.

https://huggingface.co/spaces/HuggingFaceBio/carbon-demo