Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training?

Antoine Vanderschueren, Christophe De Vleeschouwer. Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training?. In IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023, Waikoloa, HI, USA, January 2-7, 2023. pages 3797-3806, IEEE, 2023. [doi]

@inproceedings{VanderschuerenV23,
  title = {Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training?},
  author = {Antoine Vanderschueren and Christophe De Vleeschouwer},
  year = {2023},
  doi = {10.1109/WACV56688.2023.00380},
  url = {https://doi.org/10.1109/WACV56688.2023.00380},
  researchr = {https://researchr.org/publication/VanderschuerenV23},
  cites = {0},
  citedby = {0},
  pages = {3797-3806},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023, Waikoloa, HI, USA, January 2-7, 2023},
  publisher = {IEEE},
  isbn = {978-1-6654-9346-8},
}