imbalance, missing values and high dimensional feature space can negatively impact diagnostic accuracy and
add complexity to the computational problems. Such difficulties require intelligent computational methods that
are able to detect the most informative features, while preserving high predictive power.
[3,4]
Artificial Intelligence (AI) and Machine Learning (ML) are highly promising technologies for helping to make
clinical decisions and diagnose diseases. AI-driven systems can evaluate large volumes of healthcare data,
discover hidden patterns, and assist clinicians in making accurate and timely decisions. The past few years,
several machine learning algorithms, such as Random Forest (RF), Support Vector Machine (SVM), XGBoost
(XGB), CatBoost (CB) and deep learning models were effectively used for disease prediction tasks. Long Short-
Term Memory (LSTM), a specialized recurrent neural network architecture, has also been effectively employed
in healthcare applications due to its ability to capture long-term dependencies and complex patterns within
clinical and sequential medical data.
[5]
These have shown to be useful in the diagnosis of chronic diseases like
cardiovascular, diabetes disease, liver disease, breast cancer and thyroid disease. But the effectiveness of the
machine learning models is heavily dependent on the features entered into the model for training. Feature
selection is a key step in enhancing the performance of machine learning models by removing irrelevant and
redundant features. Optimal feature selection can help lower the dimensionality, make the model simpler to
interpret, save computational time, and boost predictive accuracy. The Least Absolute Shrinkage and Selection
Operator (LASSO) is one statistical method that can be used to identify significant variables by using coefficient
regularization, and metaheuristic optimization algorithms can be employed to further investigate the search
space to find the globally optimal feature subsets. Nature-inspired optimization algorithms have acquired
significant attention over the past few years as they are able to balance exploration and exploitation during the
optimization process. In this regard, the WOA
[6,7]
has demonstrated significant results in solving feature
selection and optimization issues, thanks to its low complexity and fast convergence properties. Many studies
have employed machine learning and feature selection methods for predicting thyroid disease, but there are
still some problems. However, many of the existing methods make use of statistical methods or individual
optimization techniques that can yield sub-optimal feature subset. Moreover, there are many studies that
concentrate more on the classification performance without paying enough attention to dimensionality
reduction, computational efficiency, feature stability and statistical validation. Moreover, few studies have
focused on simultaneously using statistical feature filtering with a metaheuristic optimization procedure within
a single framework for generating a compact and informative subset of features. There are also a number of
other factors reducing the confidence in existing approaches, including a lack of comprehensive validation
techniques, such as ablation analysis and statistical significance testing.
1.1 Literature review
Numerous studies have demonstrated the efficacy of Machine Learning (ML) and Artificial Intelligence (AI)
techniques in a variety of applications, including intelligent data processing, medical diagnosis, and pattern
recognition, as well as their capacity to improve prediction accuracy and decision-making performance.
[8-10]
Many feature selection methods have been introduced for use in medical diagnosis systems. Dimensionality
reduction has made extensive use of a number of statistical techniques, comprising Correlation Analysis, Chi-
Square, ANOVA, Information Gain, ReliefF, and LASSO have been largely used for dimensionality reduction. In
particular, the LASSO approach has gained a lot of interest because it can perform feature selection and
regularization at the same time.
[11,12]
In recent years, metaheuristic optimization methods have been extensively
used to solve feature selection issues. Several optimization algorithms OA, including the PSO,
[13]
the GA,
[14]
and
the ACO,
[15]
have recently showed strong performance in the optimal feature subset selection problem, the Grey
Wolf Optimizer (GWO)
[16]
the Harmony Search Optimization (HSO)
[17]
and the Harris Hawks Optimization
(HHO).
[18]
The inspiration for WOA is the bubblenet hunting technique of hump-back whales put forward by
Mirjalili and Lewis.
[7,8]
With an efficient exploration and exploitation process, WOA has gained considerable
attention in optimization problems to solve complex search problems. Optimization algorithms, however, tend
to have high dimension and/or computation complexity when applied directly to high-dimensional data sets.
Recently, hybrid feature selection frameworks have become popular, which exploit the advantages of statistical
and optimization methods.
[19]
The search space's dimensionality is decreased by statistical techniques,
optimization techniques are used to do a global search through the reduced feature subset.
[20]
Recent research
has shown that the integration of statistical feature selection methods and soft-computing optimization
techniques to find a small, yet informative set of features can greatly enhance the efficiency of the disease
predictor system. The unnecessary and relevant features are successfully eliminated by the application of
statistical methods like LASSO and the feature subset is further optimized by the application of metaheuristic
algorithms that are able to perform global search. This hybridization approach not only improves the predictive
capability, but also decreases the computational complexity and increases the interpretability of models. In the