Mosharaf Chowdhury, PhD

Dr. Mosharaf Chowdhury is a world-renowned expert in AI, Cloud Computing, and Big Data Systems. He co-created Apache Spark, a leading platform that has transformed the $100 billion AI/ML and Big Data landscape. With over 100 research publications and more than 29,000 citations, Dr. Chowdhury's work has made a significant impact in both academia and industry. He has secured $11 million in research funding, and his works have received eight “best-of” awards from academic research communities. He has received numerous national and international accolades. His research has influenced industry practices at prominent companies such as Google, Meta, Microsoft, Amazon, Databricks, Cisco, and LinkedIn, among others.

CHIEF TECHNICAL OFFICER

INTERNATIONAL AWARDS

• Google Research Scholar Award, 2023

• Meta Systems Research Award, 2022

• Meta Networking Research Award, 2022

• NSF CAREER Award, 2019

• VMware Early Career Faculty Award, 2019

• Google Faculty Research Award, 2016

Selected Publications

1. Y. Zhang, X. Zhang, G. Ananthanarayanan, A. Iyer, Y. Shu, V. Bahl, Z. M. Mao, M. Chowdhury, Vulcan: Automatic Query Planning for Live ML Analytics, USENIX NSDI 2024.

2. F. Lai, W. Zhang, R. Liu, W. Tsai, X. Wei, Y. Hu, S. Devkota, J. Huang, J. Park, X. Liu, Z. Chen, E. Wen, P. Rivera, J. You, J. Chen, M. Chowdhury, AdaEmbed: Adaptive Embedding for Large-Scale Recommendation Models, USENIX OSDI 2023.

3. F. Lai, Y. Dai, H. V. Madhyastha, M. Chowdhury, ModelKeeper: Accelerating DNN Training via Automated Training Warmup, USENIX NSDI 2023.

4. F. Lai, Y. Dai, S. S. V. Singapuram, J. Liu, X. Zhu, H. V. Madhyastha, M. Chowdhury, FedScale: Benchmarking Model and System Performance of Federated Learning at Scale, ICML 2022.

5. F. Lai, X. Zhu, H. V. Madhyastha, M. Chowdhury, Oort: Efficient Federated Learning via Guided Participant Selection, USENIX OSDI 2021.

6. P. Yu, J. Liu, M. Chowdhury, Fluid: Resource-Aware Hyperparameter Tuning Engine, MLSys 2021.

7. P. Yu, M. Chowdhury, Salus: Fine-Grained GPU Sharing Primitives for Deep Learning Applications, MLSys 2020.

8. J. Gu, M. Chowdhury, K. G. Shin, Y. Zhu, M. Jeon, J. Qian, H. Liu, C. Guo, Tiresias: A GPU Cluster Manager for Distributed Deep Learning, USENIX NSDI 2019.

9. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, I. Stoica, Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing, USENIX NSDI 2012.

10. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, I. Stoica, Spark: Cluster Computing with Working Sets, USENIX HotCloud 2010.