📚TheoryIntermediate
Depth vs Width Tradeoffs
Depth adds compositional power: stacking layers lets neural networks represent functions with many repeated patterns using far fewer neurons than a single wide layer.
#depth vs width#relu#piecewise linear+12