avatar

Cong Xie

I'm a 5th year PhD student of Computer Science in University of Illinois at Urbana Champaign. I am co-advised by Prof. Indranil Gupta and Prof. Sanmi Koyejo, and work with Distributed Protocols Research Group (DPRG). My research is mainly about distributed machine learning.
Address Room #3333,
Thomas M. Siebel Center for Computer Science,
201 North Goodwin Avenue,
University of Illinois at Urbana Champaign,
Urbana,
IL 61801-2302, US
Email cx2@illinois.edu
Phone 2178196957 (US)

Research Interest

  • Large-scale Machine Learning
  • Distributed Systems
  • Graph Partitioning

Publication

  • Cong Xie , Shuai Zheng, Sanmi Koyejo, Indranil Gupta, Mu Li, Haibin Lin. CSER: Communication-efficient SGD with Error Reset. Advances in Neural Information Processing Systems (NeurIPS) 2020.


  • Cong Xie , Sanmi Koyejo, Indranil Gupta. Asynchronous Federated Optimization. NeurIPS workshop on Optimization for Machine Learning (OPT) 2020.


  • Cong Xie , Sanmi Koyejo, Indranil Gupta, Haibin Lin. Local AdaAlter: Communication-Efficient Stochastic Gradient Descent with Adaptive Learning Rates. NeurIPS workshop on Optimization for Machine Learning (OPT) 2020.


  • Cong Xie , Sanmi Koyejo, Indranil Gupta. Zeno++: Robust Fully Asynchronous SGD. International Conference on Machine Learning (ICML) 2020.


  • Cong Xie , Sanmi Koyejo, Indranil Gupta. SLSGD: Secure and Efficient Distributed On-device Machine Learning. European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD) 2019.


  • Cong Xie , Sanmi Koyejo, Indranil Gupta. Fall of Empires: Breaking Byzantine-tolerant SGD by Inner Product Manipulation. Uncertainty in Artificial Intelligence (UAI) 2019.


  • Cong Xie , Sanmi Koyejo, Indranil Gupta. Zeno: Distributed Stochastic Gradient Descent with Suspicion-based Fault-tolerance. International Conference on Machine Learning (ICML) 2019.


  • Cong Xie , Ling Yan, Wu-Jun Li, and Zhihua Zhang. Distributed Power-Law Graph Computing: Theoretical and Empirical Analysis. In Proceedings of Conference on Neural Information Processing Systems (NeurIPS) 2014. ( PDF, Code )


  • Shenjian Zhao, Cong Xie , and Zhihua Zhang. A Scalable and Extensible Framework for Superposition-Structured Models. The Thirtieth Conference on Artificial Intelligence (AAAI-16) 2015.


  • Wuxuan Jiang, Cong Xie , and Zhihua Zhang. Wishart Mechanism for Differentially Private Principle Components Analysis. The Thirtieth Conference on Artificial Intelligence (AAAI-16) 2015. ( http://arxiv.org/abs/1511.05680 )


  • Cong Xie , Donglin Yang, Yixiang Huang, and Donglai Sun. Feature Extraction and Ensemble Decision Tree Classifier in Plant Failure Detection. Annual Conference of the Prognostics and Health Management Society (IEEE PHM2015 Data Challenge Winner Paper) 2015. ( PDF, Code )


Preprints

  • Cong Xie , Shuai Zheng, Sanmi Koyejo, Indranil Gupta, Mu Li, and Haibin Lin. CSER: Communication-efficient SGD with Error Reset. ( https://arxiv.org/abs/2007.13221 )


  • Cong Xie , Sanmi Koyejo, Indranil Gupta, and Haibin Lin. Local AdaAlter: Communication-Efficient Stochastic Gradient Descent with Adaptive Learning Rates. ( https://arxiv.org/abs/1911.09030 )


  • Cong Xie , Sanmi Koyejo, and Indranil Gupta. Asynchronous Federated Optimization. ( https://arxiv.org/abs/1903.03934 )


  • Cong Xie , Sanmi Koyejo, and Indranil Gupta. Phocas: dimensional Byzantine-resilient stochastic gradient descent. ( https://arxiv.org/abs/1805.09682 )


  • Cong Xie , Ling Yan, Xiao-Fan Niu, Wuxuan Jiang, Wu-Jun Li, and Zhihua Zhang. Distributed Power-Law Graph Computing: Theoretical and Empirical Analysis. ( Long Version, Code )


  • Cong Xie , Wu-Jun Li, and Zhihua Zhang. S-PowerGraph: Streaming Graph Partitioning for Natural Graphs by Vertex-Cut. ( http://arxiv.org/abs/1511.02586 )


  • Cong Xie , Wu-Jun Li, and Zhihua Zhang. A New Relaxation Approach to Normalized Hypergraph Cut. ( http://arxiv.org/abs/1511.02595 )


Academic Service

Journal Reviewer

  • Journal of Machine Learning Research
  • ACM Transactions on Autonomous and Adaptive Systems
  • IEEE Transactions on Signal Processing

Honors & Awards

  • J.P. Morgan 2020 AI Research PhD Fellowship Awards
  • National Scholarship (Top 2%)
  • 3rd place in IEEE PHM 2015 Data Challenge (Leaderboard)
  • NIPS Travel Award
  • SJTU Academic Excellence Scholarship Class-B (Top 10%)
  • SJTU Academic Excellence Scholarship Class-C (2 Times, Top 20%)
  • 2nd provincial-level in China Undergraduate Mathematical Contest in Modeling

Lecture Notes