TY - JOUR
T1 - DenoMAE
T2 - A Multimodal Autoencoder for Denoising Modulation Signals
AU - Faysal, Atik
AU - Boushine, Taha
AU - Rostami, Mohammad
AU - Roshan, Reihaneh Gh
AU - Wang, Huaxia
AU - Muralidhar, Nikhil
AU - Sahoo, Avimanyu
AU - Yao, Yu Dong
N1 - Publisher Copyright:
© 1997-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - We propose Denoising Masked Autoencoder (DenoMAE), a novel multimodal autoencoder framework for denoising modulation signals during pretraining. DenoMAE extends the concept of masked autoencoders by incorporating multiple input modalities, including noise as an explicit modality, to enhance cross-modal learning and improve denoising performance. The network is pre-trained using unlabeled noisy modulation signals and constellation diagrams, effectively learning to reconstruct their equivalent noiseless signals and diagrams. DenoMAE achieves state-of-the-art accuracy in automatic modulation classification (AMC) tasks with significantly fewer training samples, demonstrating a 10 × reduction in unlabeled pretraining data and a 3 × reduction in labeled fine-tuning data compared to existing approaches. Moreover, our model exhibits robust performance across varying Signal-to-Noise Ratios (SNRs) and supports extrapolation on unseen lower SNRs. The results indicate that DenoMAE is an efficient, flexible, and data-efficient solution for denoising and classifying modulation signals in challenging, noise-intensive environments.
AB - We propose Denoising Masked Autoencoder (DenoMAE), a novel multimodal autoencoder framework for denoising modulation signals during pretraining. DenoMAE extends the concept of masked autoencoders by incorporating multiple input modalities, including noise as an explicit modality, to enhance cross-modal learning and improve denoising performance. The network is pre-trained using unlabeled noisy modulation signals and constellation diagrams, effectively learning to reconstruct their equivalent noiseless signals and diagrams. DenoMAE achieves state-of-the-art accuracy in automatic modulation classification (AMC) tasks with significantly fewer training samples, demonstrating a 10 × reduction in unlabeled pretraining data and a 3 × reduction in labeled fine-tuning data compared to existing approaches. Moreover, our model exhibits robust performance across varying Signal-to-Noise Ratios (SNRs) and supports extrapolation on unseen lower SNRs. The results indicate that DenoMAE is an efficient, flexible, and data-efficient solution for denoising and classifying modulation signals in challenging, noise-intensive environments.
KW - Multi-modality
KW - constellation diagrams
KW - denoising
KW - modulation classification
KW - vision transformer
UR - https://www.scopus.com/pages/publications/105005436406
UR - https://www.scopus.com/pages/publications/105005436406#tab=citedBy
U2 - 10.1109/LCOMM.2025.3570602
DO - 10.1109/LCOMM.2025.3570602
M3 - Article
AN - SCOPUS:105005436406
SN - 1089-7798
VL - 29
SP - 1659
EP - 1663
JO - IEEE Communications Letters
JF - IEEE Communications Letters
IS - 7
ER -