Open Access

ARTICLE

Enhanced Particle Swarm Optimization Algorithm Based on SVM Classifier for Feature Selection

Xing Wang^1,*, Huazhen Liu¹, Abdelazim G. Hussien², Gang Hu¹, Li Zhang³

1 School of Science, Xi’an University of Technology, Xi’an, 710054, China
2 Department of Computer and Information Science, Linköping University, Linköping, 58183, Sweden
3 School of Science, Chang’an University, Xi’an, 710064, China

* Corresponding Author: Xing Wang. Email:

(This article belongs to the Special Issue: Swarm and Metaheuristic Optimization for Applied Engineering Application)

Computer Modeling in Engineering & Sciences 2025, 142(3), 2791-2839. https://doi.org/10.32604/cmes.2025.058473

Received 13 September 2024; Accepted 06 January 2025; Issue published 03 March 2025

Abstract

Feature selection (FS) is essential in machine learning (ML) and data mapping by its ability to preprocess high-dimensional data. By selecting a subset of relevant features, feature selection cuts down on the dimension of the data. It excludes irrelevant or surplus features, thus boosting the performance and efficiency of the model. Particle Swarm Optimization (PSO) boasts a streamlined algorithmic framework and exhibits rapid convergence traits. Compared with other algorithms, it incurs reduced computational expenses when tackling high-dimensional datasets. However, PSO faces challenges like inadequate convergence precision. Therefore, regarding FS problems, this paper presents a binary version enhanced PSO based on the Support Vector Machines (SVM) classifier. First, the Sand Cat Swarm Optimization (SCSO) is added to enhance the global search capability of PSO and improve the accuracy of the solution. Secondly, the Latin hypercube sampling strategy initializes populations more uniformly and helps to increase population diversity. The last is the roundup search strategy introducing the grey wolf hierarchy idea to help improve convergence speed. To verify the capability of Self-adaptive Cooperative Particle Swarm Optimization (SCPSO), the CEC2020 test suite and CEC2022 test suite are selected for experiments and applied to three engineering problems. Compared with the standard PSO algorithm, SCPSO converges faster, and the convergence accuracy is significantly improved. Moreover, SCPSO’s comprehensive performance far exceeds that of other algorithms. Six datasets from the University of California, Irvine (UCI) database were selected to evaluate SCPSO’s effectiveness in solving feature selection problems. The results indicate that SCPSO has significant potential for addressing these problems.

---

Keywords

---