Supermasks in Superposition
TL;DR
We overlay thousands of supermasks and retrieve the correct one, without knowing the task identity in continual learning.
Venue
In Thirty-fourth Conference on Neural Information Processing Systems (NeurIPS 2020).
BibTeX
@article{wortsman2020supermasks,
title={Supermasks in Superposition},
author={Mitchell Wortsman and Vivek Ramanujan and Rosanne Liu and Aniruddha Kembhavi and Mohammad Rastegari and Jason Yosinski and Ali Farhadi},
year={2020},
eprint={2006.14769},
archivePrefix={arXiv},
primaryClass={cs.LG}
}
title={Supermasks in Superposition},
author={Mitchell Wortsman and Vivek Ramanujan and Rosanne Liu and Aniruddha Kembhavi and Mohammad Rastegari and Jason Yosinski and Ali Farhadi},
year={2020},
eprint={2006.14769},
archivePrefix={arXiv},
primaryClass={cs.LG}
}
Date
June, 2020