I am recruiting in the following projects
*Distributed Learning Algorithms*
Focusing on new methods to address large models + low communication, emphasis on model parallelism techniques, decentralized communication, local learning.
Some examples to give a flavor
https://arxiv.org/abs/2410.11998
https://arxiv.org/pdf/2306.08289
https://arxiv.org/pdf/2406.02052
https://arxiv.org/pdf/1901.08164
*Learned Optimizers for Foundational Model Training*
Some work to give a flavor
https://arxiv.org/pdf/2203.11860.pdf
https://openreview.net/pdf?id=MusMaHCrs2
https://arxiv.org/pdf/2406.00153
Applicants can be at different levels
MS, PhD students, MS or PhD level interns, or Postdoc. Should already have solid foundational knowledge in deep/machine learning and strong programming skills.
If contacting me about any opportunities put [ReadWebsite] in your email title so that I know you read this page.