Here, I maintain a collection of lecture notes, books, tutorials, papers, talks etc. that I found to be super helpful.

Statistical Machine Learning
  • Duchi's lecture notes on Statistics and Information Theory.

  • Tropp's lecture notes on Concentration Inequalities.

  • Intro. to Statistical Learning Theory by Bousquet, Boucheron, and Lugosi.

    • Language models
  • Super useful and comprehensive book by Jurafsky and Martin on classical and modern NLP.

  • Great book on Foundations of Large Language Models by Tong Xiao and Jingbo Zhu, with sufficient detail and coverage of topics.