tuta.io
Overfitting jeopardizes deep learners dealing with noisy medical data. Despite its importance, our understanding of how neural networks generalize in medical imaging remains elusive. In this work, we propose to characterize the generalization profile of a model by evaluating its F1-score under data with varying noise levels. We use two architecturally distinct neural models, a Multilayer Perceptron (MLP) and a Convolutional Neural Network (CNN), to classify brain tumor in Magnetic Resonance Images (MRI) in a independent test data with different levels of salt-and-pepper noise. Our results reveal a clear distinction between the generalization profile of MLPs and CNNs. We demonstrate that shallow models can perform comparably to deep models when regularization is neglected. We also show that deep neural models benefit more from noise injection than shallow neural models, regardless of the differences between training and test data distribution. Our study sheds light on the nature of generalization in neural networks, laying the groundwork for further investigations of their underlying learning processes.
IEEE Latin American Conference on Computational Intelligence (LA-CCI), Recife, Brazil. 2023.
[Link to publication]