Unveiling Equity: Exploring Feature Dependency using Complex-Valued Neural Networks and Attention Mechanism for Fair Data Analysis

Xuting Tang, Mengjiao Zhang, Abdul Rafae Khan, Steve Y. Yang, Jia Xu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the increasing use of big data, cloud computing, and machine learning in high-stake domains such as justice systems, financial institutions, and healthcare, concerns about fairness have become more prominent. This paper presents a novel approach to foster fair decision-making by tackling social bias and enhancing transparency in machine learning models. The proposed framework leverages quantum-inspired complex-valued neural networks and attention-based networks, offering improved transparency in modeling the decision process for interpreting feature importance and dependency. Furthermore, our approach tackles the challenges posed by imbalanced data through the incorporation of focal loss and oversampling techniques, resulting in reduced prediction errors. Through extensive experiments conducted on real-life datasets encompassing criminal charge prediction, financial fraud detection, and credit card default payment prediction, our approach consistently demonstrates reliable prediction precision and recall. Notably, our analysis of feature significance highlights the statistical importance of task-related features such as historical records of bank transactions or criminal charge history, while socially biased identifiers like race, gender, and age exhibit minimal significance. By excluding these biased features, our approach enhances fairness without compromising prediction accuracy, thereby contributing to the advancement of fair decision-making in big data and cloud computing across various high-stake domains.

Original languageEnglish
Title of host publication2023 IEEE 12th International Conference on Cloud Networking, CloudNet 2023
Pages256-264
Number of pages9
ISBN (Electronic)9798350313062
DOIs
StatePublished - 2023
Event12th IEEE International Conference on Cloud Networking, CloudNet 2023 - Hoboken, United States
Duration: 1 Nov 20233 Nov 2023

Publication series

Name2023 IEEE 12th International Conference on Cloud Networking, CloudNet 2023

Conference

Conference12th IEEE International Conference on Cloud Networking, CloudNet 2023
Country/TerritoryUnited States
CityHoboken
Period1/11/233/11/23

Keywords

  • Data Analysis
  • Fair Machine Learning in Cloud Computing
  • Model Interpretability

Fingerprint

Dive into the research topics of 'Unveiling Equity: Exploring Feature Dependency using Complex-Valued Neural Networks and Attention Mechanism for Fair Data Analysis'. Together they form a unique fingerprint.

Cite this