ThaGooInYaBrain•

Slightly tangential, but I'd like to better understand why only a tiny fraction (0.3% listed for BERT) of a model's neurons are used during inference.

I suppose each layer learns a large pool of "candidate features" as outputs, and that from there the next layer simply learns which of those candidate inputs are the most useful for its purposes, and thus simply ignores all the other candidates as irrelevant?

2
ThaGooInYaBrain•

Follow up: why can't we do something like post-training neuron-decay? Observe which neurons never get activated, reorder the matrices accordingly, and then just start slicing whole rows/columns off.

1