Non-smooth non-convex optimization for training deep neural networks
Semestr: Winter
Range: 2P+2C
Completion:
Credits: 6
Programme type: Master
Study form: Fulltime
Course language: Czech
Summary:
Keywords:
Course syllabus:
Seminar syllabus:
Literature:
Allen Gehret et al., Deep Learning as the Disciplined Construction of Tame Objects, https://arxiv.org/abs/2509.18025
Lou van den Dries, Tame topology and o-minimal structures, London Mathematical Society Lecture Note Series, vol. 248, Cambridge University Press, Cambridge, 1998.
Damek Davis, Dmitriy Drusvyatskiy, Sham Kakade, and Jason D Lee, Stochastic subgradient method converges on tame functions, Foundations of computational mathematics 20 (2020), no. 1, 119–154.
A. D. Ioffe, An invitation to tame optimization, SIAM Journal on Optimization 19 (2008), no. 4, 1894–1917.