Interesting problems in DL theory

Here are some research directions I worked on with before my PhD. Mathematics of machine learning is a very cool field, although these days I think empirical research is a bit more impactful. When are ReLU neural networks injective? Update Nov 2021: I managed to solve some of the problems below in my Master thesis. Update Oct 2022: Antoine Maillard and others have apparently resolved the injectivity phase transition in an upcoming publication!...

April 8, 2021