Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics

Justin Sahs, Ryan Pyle, Aneel Damaraju, Josue Ortega Caro, Onur Tavaslioglu, Andy Lu, Fabio Anselmi, Ankit B. Patel. Shallow Univariate ReLU Networks as Splines: Initialization, Loss Surface, Hessian, and Gradient Flow Dynamics. Frontiers Artif. Intell., 5:889981, 2022. [doi]

Authors

Justin Sahs

This author has not been identified. Look up 'Justin Sahs' in Google

Ryan Pyle

This author has not been identified. Look up 'Ryan Pyle' in Google

Aneel Damaraju

This author has not been identified. Look up 'Aneel Damaraju' in Google

Josue Ortega Caro

This author has not been identified. Look up 'Josue Ortega Caro' in Google

Onur Tavaslioglu

This author has not been identified. Look up 'Onur Tavaslioglu' in Google

Andy Lu

This author has not been identified. Look up 'Andy Lu' in Google

Fabio Anselmi

This author has not been identified. Look up 'Fabio Anselmi' in Google

Ankit B. Patel

This author has not been identified. Look up 'Ankit B. Patel' in Google