[Glean] ResNet-50 Architecture and # MACs
ResNet-50 Architecture and # MACs
ResNet-50 Architecture1
From the figure above, ResNet-50 contains 2 separate convolutional layers plus 16 building block where each building block contains three convolutional layers.
Building Block1
The building block in residual learning contains one residual representations and one shortcut connections which skipping one or more layers.
In ResNet-50, the shortcut connections skipping three layers.
# Weights and # MACs2
We can conclude that the last three building blocks occupy more weights while their computation operations near the same between different building blocks.