Concepts2
📚TheoryAdvanced
Neural Network Expressivity
Neural network expressivity studies what kinds of functions different network architectures can represent and how efficiently they can do so.
#neural network expressivity#depth separation#relu linear regions+12
⚙️AlgorithmAdvanced
Slope Trick
Slope Trick is a technique to maintain a convex piecewise-linear function implicitly using two heaps and a running constant.
#slope trick#convex dp#piecewise linear+11