manuxOP•

tl;dr: on ImageNet, categories are learned hierarchically in time and (embedding) space. This relates to depth as well (lower layers learn common features, higher layers learn separable features, hierarchically).

1