Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm

  • Shaoyi Huang
  • , Dongkuan Xu
  • , Ian En Hsu Yen
  • , Yijue Wang
  • , Sung En Chang
  • , Bingbing Li
  • , Shiyang Chen
  • , Mimi Xie
  • , Sanguthevar Rajasekaran
  • , Hang Liu
  • , Caiwen Ding

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

14 Scopus citations

Fingerprint

Dive into the research topics of 'Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm'. Together they form a unique fingerprint.

Computer Science

Social Sciences