Interesting Problems

Here are some research directions I sometimes play with. I have spent between one hour and one month thinking on each of these questions. How wide should one-hidden-layer networks be to be robust (when interpolating random data)? The general idea of the tradeoff between neural network robustness; and neural network layer widths is well known1. Of course, one should compare networks with the same accuracy; for simplicity, consider networks that interpolate a random dataset....

April 8, 2021

Blogs I Like

There are lots of people who write better than me. Here are some of the less known: Neel Nanda Vitaly Kurin Daniel Seita I think famous researchers who still take time to write blogs are a gift. Here are some in machine learning: Lilian Weng Francis Bach S├ębastien Bubeck If you have (or have read) a cool blog along these lines, feel free to send me a link....