Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask

TL;DR

The Lottery Ticket Hypothesis is pretty cool. Here we analyze it more deeply to reveal new findings: zero is special; signs matter; supermasks exist.

Venue
In Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019).
BibTeX
@inproceedings{zhou2019deconstructing,
  title={Deconstructing lottery tickets: Zeros, signs, and the supermask},
  author={Zhou, Hattie and Lan, Janice and Liu, Rosanne and Yosinski, Jason},
  booktitle={Advances in Neural Information Processing Systems},
  pages={3592–3602},
  year={2019}
}
Date