Skip to main content
User Image

Khalil M El Hindi

Professor

Faculty memeber

علوم الحاسب والمعلومات
Room 2189, Building 31
publication
Journal Article
2020

Error-Based Noise Filtering During Neural Network Training

Fahad-Alharbi, Khalil El Hindi; Saad Al-Ahmadi, . 2020

The problem of dealing with noisy data in neural network-based models has been receiving more attention by researchers with the aim of mitigating possible consequences on learning. Several methods have been applied by some researchers to enhance data as a pre-process of training while other researchers have attempted to make models of learning aware of noise and thus able to deal with noisy instances. We propose a simple and efficient method that we call Error-Based Filtering (EBF) that is used during training as a filtration technique for supervised learning in neural network-based models. EBF is independent of the model architecture and can therefore be involved in any neural network-based model. Our approach is based on monitoring and analyzing the distribution of values of the loss (error) function for each instance during training. In addition, EBF can be integrated with semi-supervised learning to take advantage of the identified noisy instances and improve classification. An advantage of EBF is to achieve competitive performance compared with other state-of-the-art methods with many fewer additional tasks in a procedure of training. Our evaluation of the efficacy of our method on three well-known benchmark datasets demonstrates an improvement on classification accuracy in the presence of noise.

Publication Work Type
PHD
Volume Number
8
Magazine \ Newspaper
IEEE Access
more of publication
publications

The combination of collaborative deep learning and Cyber-Physical Systems (CPSs) has the potential to improve decision-making, adaptability, and efficiency in dynamic and distributed environments…

by Alya Alshammari, and Khalil El Hindi
Published in:
Applied Sciences
publications

Naïve Bayes (NB) classification performance degrades if the conditional independence assumption is not satisfied or if the conditional probability estimate is not realistic due to the attributes…

by Fahad S. Alenazi, Khalil El Hindi, and Basil AsSadhan