UltraLLaDA: Scaling the Context Length to 128K for Diffusion Large Language Models
Guangxin He, Shen Nie, Fengqi Zhu, Yuankang Zhao, Tianyi Bai, Ran Yan, Jie Fu, Chongxuan Li, Binhang Yuan.
CV
Education
- Ph.D in Version Control Theory, GitHub University, 2018 (expected)
- M.S. in Jekyll, GitHub University, 2014
- B.S. in GitHub, GitHub University, 2012
Work experience
- Spring 2024: Academic Pages Collaborator
- Github University
- Duties includes: Updates and improvements to template
- Supervisor: The Users
- Fall 2015: Research Assistant
- Github University
- Duties included: Merging pull requests
- Supervisor: Professor Hub
- Summer 2015: Research Assistant
- Github University
- Duties included: Tagging issues
- Supervisor: Professor Git
Skills
- Skill 1
- Skill 2
- Sub-skill 2.1
- Sub-skill 2.2
- Sub-skill 2.3
- Skill 3
Publications
Multi-step Visual Reasoning with Visual Tokens Scaling and Verification
Tianyi Bai, Zengjie Hu, Fupeng Sun, Qiu Jiantao, Yizhen Jiang, Guangxin He, Bohan Zeng, Conghui He, Binhang Yuan, Wentao Zhang.
Modeling and Optimizing the Scaling Performance in Distributed Deep Learning Training
Ting Liu*, Tianhao Miao*, Qinghua Wu, Zhenyu Li, Guangxin He Jiaoren Wu, Shengzhuo Zhang, Xingwu Yang, Gareth Tyson, Gaogang Xie.
Talks
Conference Proceeding talk 3 on Relevant Topic in Your Field
Conference proceedings talk at Testing Institute of America 2014 Annual Conference, Los Angeles, CA
Talk 2 on Relevant Topic in Your Field
Talk at London School of Testing, London, UK
Tutorial 1 on Relevant Topic in Your Field
Tutorial at UC-Berkeley Institute for Testing Science, Berkeley CA, USA
Talk 1 on Relevant Topic in Your Field
Talk at UC San Francisco, Department of Testing, San Francisco, California
Teaching
Service and leadership
- Currently signed in to 43 different slack teams