Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics

Justin Sahs, Ryan Pyle, Aneel Damaraju, Josue Ortega Caro, Onur Tavaslioglu, Andy Lu, Fabio Anselmi, Ankit B. Patel. Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics. Frontiers Artif. Intell., 5:889981, 2022. [doi]

@article{SahsPDCTLAP22,
  title = {Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics},
  author = {Justin Sahs and Ryan Pyle and Aneel Damaraju and Josue Ortega Caro and Onur Tavaslioglu and Andy Lu and Fabio Anselmi and Ankit B. Patel},
  year = {2022},
  doi = {10.3389/frai.2022.889981},
  url = {https://doi.org/10.3389/frai.2022.889981},
  researchr = {https://researchr.org/publication/SahsPDCTLAP22},
  cites = {0},
  citedby = {0},
  journal = {Frontiers Artif. Intell.},
  volume = {5},
  pages = {889981},
}