Why There Is So Little Work on High-Performance Active Inference With Predictive Coding, Structural Learning and Transformers?
https://github.com/raf212/SuperNova -> SuperNova
MY Question:
Why is there no existing work to really take advantage of our existing proven transformer to create more refined version Active inference? If we are that eager to create unnecessary generalization on silicon to use it in wars lol.
Nah, but really, why is there no work in the whole field??????????
Last 2 years, I was working on building a model in C++ where each individual NODE supporting 2 EDGE DAG relation, up to 10 compile-time set data segments supporting basic C data types and atomic / raw / double buffer .... profile, with concurrent Structural modification, but most importantly keeping the whole architecture relocatable to disk or shared memory.
My Hypothesis:
My Hypothesis is a Biological end-to-end Cognitive system might have more parts than we don't know yet, but Transformers(backprop) + Structural learning + Active inference(Predictive coding) all are proven and definitely a part of biological learning.
I understand per-node update is expensive in active inference, but we never need per-node update in large tasks. The specific DAG paths can be batched and vectorized and can use GPU for compute.
Structural modification might be costly, but not significantly. Even in biology it doesn't happen that randomly nor frequently.
Most importantly, we already exploited transformers, what is extremely good at large task. Active inference supports that too. Learning is not bound by any specific method regardless what biological brain / learning our silicons are best at compound computation, and it's more optimized, and we also have 4-5 GHZ CPUs with 256 cores what will be extremely good and enough to handle the Structural learning + Predictive coding / rate coding.
But when you try to look up any existing fast codebase like that, the whole field is empty cornfield.
MY Result:
My architecture passes all the requirements, but still I'm implementing GHGF to test predictive coding, and later I will add GPU vectorization through AdaptiveCpp.
I will eventually write my own paper, but I'm sooooo Lazy lol. If someone want to take a look, go ahead. I will make it opensource after my first paper.
Finally, sorry for being dumb lol.
Raf.
LATEST SUPPORTING PAPER:
Active inference and artificial reasoning
Posted Sep 11, 2026, 3:30 PM UTC