Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm

Shaoyi Huang, Dongkuan Xu, Ian En Hsu Yen, Yijue Wang, Sung En Chang, Bingbing Li, Shiyang Chen, Mimi Xie, Sanguthevar Rajasekaran, Hang Liu, Caiwen Ding

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

9 Scopus citations

Fingerprint

Dive into the research topics of 'Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm'. Together they form a unique fingerprint.

Computer Science

Social Sciences