Learning Dynamics in Linear VAE: Posterior Collapse Threshold, Superfluous Latent Space Pitfalls, and Speedup with KL Annealing

Yuma Ichikawa, Koji Hukushima. Learning Dynamics in Linear VAE: Posterior Collapse Threshold, Superfluous Latent Space Pitfalls, and Speedup with KL Annealing. In Sanjoy Dasgupta, Stephan Mandt, Yingzhen Li, editors, International Conference on Artificial Intelligence and Statistics, 2-4 May 2024, Palau de Congressos, Valencia, Spain. Volume 238 of Proceedings of Machine Learning Research, pages 1936-1944, PMLR, 2024. [doi]

@inproceedings{IchikawaH24,
  title = {Learning Dynamics in Linear VAE: Posterior Collapse Threshold, Superfluous Latent Space Pitfalls, and Speedup with KL Annealing},
  author = {Yuma Ichikawa and Koji Hukushima},
  year = {2024},
  url = {https://proceedings.mlr.press/v238/ichikawa24a.html},
  researchr = {https://researchr.org/publication/IchikawaH24},
  cites = {0},
  citedby = {0},
  pages = {1936-1944},
  booktitle = {International Conference on Artificial Intelligence and Statistics, 2-4 May 2024, Palau de Congressos, Valencia, Spain},
  editor = {Sanjoy Dasgupta and Stephan Mandt and Yingzhen Li},
  volume = {238},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
}