Sign Bit is Enough: A Learning Synchronization Framework for Multi-hop All-reduce with Ultimate Compression

Feijie Wu, Shiqi He, Song Guo, Zhihao Qu, Haozhao Wang, Weihua Zhuang, Jie Zhang
July 2022
PDF
Type
Conference paper
Publication
In The 59th Design Automation Conference (DAC) (CCF-A)
Feijie Wu
Feijie Wu
Mphil, 2020-2022, PhD at Purdue University
Song Guo
Song Guo
Chair Professor
Zhihao Qu
Zhihao Qu
Researcher, 2018-2019, Associate Professor at Hohai University
Jie Zhang
Jie Zhang
Research Assistant Professor