DiracNets: Training Very Deep Neural Networks Without Skip-Connections

Sergey ZagoruykoNikos Komodakis

   Papers with code   Abstract  PDF

Deep neural networks with skip-connections, such as ResNet, show excellent performance in various image classification benchmarks. It is though observed that the initial motivation behind them - training deeper networks - does not actually hold true, and the benefits come from increased capacity, rather than from depth... (read more)

Benchmarked Models

RANK
MODEL
REPO
CODE RESULT
PAPER RESULT
ε-REPRODUCED
BUILD
1
DiracNetV2-34
71.2%
--
2
DiracNetV2-18
68.5%
--