Open Access

ARTICLE

Salient Features Guided Augmentation for Enhanced Deep Learning Classification in Hematoxylin and Eosin Images

Tengyue Li^1,*, Shuangli Song¹, Jiaming Zhou², Simon Fong^2,3, Geyue Li⁴, Qun Song³, Sabah Mohammed⁵, Weiwei Lin⁶, Juntao Gao⁷

1 School of Information, North China University of Technology, Beijing, 100144, China
2 Department of Computer and Information Science, University of Macau, Macau SAR, 999078, China
3 Department of Artificial Intelligence, Chongqing Technology and Business University, Chongqing, 400067, China
4 Department of Mathematics, University of Macau, Macau SAR, 999078, China
5 Computer Science Department, Lakehead University, Thunder Bay, ON P7B 5E1, Canada
6 School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510640, China
7 Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, 100084, China

* Corresponding Author: Tengyue Li. Email:

Computers, Materials & Continua 2025, 84(1), 1711-1730. https://doi.org/10.32604/cmc.2025.062489

Received 19 December 2024; Accepted 10 February 2025; Issue published 09 June 2025

Abstract

Hematoxylin and Eosin (H&E) images, popularly used in the field of digital pathology, often pose challenges due to their limited color richness, hindering the differentiation of subtle cell features crucial for accurate classification. Enhancing the visibility of these elusive cell features helps train robust deep-learning models. However, the selection and application of image processing techniques for such enhancement have not been systematically explored in the research community. To address this challenge, we introduce Salient Features Guided Augmentation (SFGA), an approach that strategically integrates machine learning and image processing. SFGA utilizes machine learning algorithms to identify crucial features within cell images, subsequently mapping these features to appropriate image processing techniques to enhance training images. By emphasizing salient features and aligning them with corresponding image processing methods, SFGA is designed to enhance the discriminating power of deep learning models in cell classification tasks. Our research undertakes a series of experiments, each exploring the performance of different datasets and data enhancement techniques in classifying cell types, highlighting the significance of data quality and enhancement in mitigating overfitting and distinguishing cell characteristics. Specifically, SFGA focuses on identifying tumor cells from tissue for extranodal extension detection, with the SFGA-enhanced dataset showing notable advantages in accuracy. We conducted a preliminary study of five experiments, among which the accuracy of the pleomorphism experiment improved significantly from 50.81% to 95.15%. The accuracy of the other four experiments also increased, with improvements ranging from 3 to 43 percentage points. Our preliminary study shows the possibilities to enhance the diagnostic accuracy of deep learning models and proposes a systematic approach that could enhance cancer diagnosis, contributing as a first step in using SFGA in medical image enhancement.

---

Keywords

---