Multi-block alternating direction method of multipliers for ultrahigh dimensional quantile fused regression

Xiaofei Wu, Hao Ming, Zhimin Zhang, Zhenyu Cui

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

In this paper, we consider a quantile fused LASSO regression model that combines quantile regression loss with the fused LASSO penalty. Intuitively, this model offers robustness to outliers, thanks to the quantile regression, while also effectively recovering sparse and block coefficients through the fused LASSO penalty. To adapt our proposed method for ultrahigh dimensional datasets, we introduce an iterative algorithm based on the multi-block alternating direction method of multipliers (ADMM). Moreover, we demonstrate the global convergence of the algorithm and derive comparable convergence rates. Importantly, our ADMM algorithm can be easily applied to solve various existing fused LASSO models. In terms of theoretical analysis, we establish that the quantile fused LASSO can achieve near oracle properties with a practical penalty parameter, and additionally, it possesses a sure screening property under a wide class of error distributions. The numerical experimental results support our claims, showing that the quantile fused LASSO outperforms existing fused regression models in robustness, particularly under heavy-tailed distributions.

Original languageEnglish
Article number107901
JournalComputational Statistics and Data Analysis
Volume192
DOIs
StatePublished - Apr 2024

Keywords

  • Fused LASSO
  • Multi-block ADMM
  • Oracle properties
  • Quantile regression

Fingerprint

Dive into the research topics of 'Multi-block alternating direction method of multipliers for ultrahigh dimensional quantile fused regression'. Together they form a unique fingerprint.

Cite this