SciELO - Scientific Electronic Library Online

 
vol.22 número5Dyeing ability of C. longa L. and T. stans (L.) Juss. Ex Kunth on unmordanted and mordanted silk and cotton fabricsOptimising acceptability using a user-centred design approach of a robotic software in Industry 4.0: A case study índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • No hay artículos similaresSimilares en SciELO

Compartir


Journal of applied research and technology

versión On-line ISSN 2448-6736versión impresa ISSN 1665-6423

J. appl. res. technol vol.22 no.5 Ciudad de México oct. 2024  Epub 11-Ago-2025

https://doi.org/10.22201/icat.24486736e.2024.22.5.2422 

Articles

Comparison of machine learning algorithms for dengue virus (DENV) classification

Y. V. Exebio-Chepea  * 
http://orcid.org/0000-0002-2076-2120

J. A. Bravo-Ruiza 
http://orcid.org/0000-0003-1929-3969

V. A. Tuesta-Montezaa 

aEscuela Profesional de Ingenieria de Sistemas; Facultad de Ingenieria, Arquitectura y Urbanismo; Universidad Señor de Sipán, Chiclayo, Perú


Abstract:

Dengue transmitted by the Aedes aegypti mosquito, requires accurate classification of cases for effective management, which is currently a gap of study with a particular case in Peru. The research focuses on leveraging machine learning algorithms to improve diagnosis and streamline control strategies concerning dengue transmission cases. Using a dataset from a public hospital, covering 21,157 cases classified by period, outcome, sex, age, symptoms, and origin (autochthonous or imported), the study performed a comparative analysis of support vector machine, random forest, and artificial neural network algorithms. The data set was divided into 70% (14,809 cases) for training and 30% (6,348 cases) for testing. The results revealed that artificial neural network came out on top with 86.47% accuracy and 92.91% recall in classifying dengue-related cases. It is concluded that the implementation of support vector machine proved to be sensitive of 99.05%, highlights the effectiveness in dengue case classification.

Keywords: Machine learning; health; algorithms; metrics; dengue

1. Introduction

Dengue, caused by the dengue virus transmitted by Aedes aegypti mosquitoes (Figure 1), represents a global threat in more than 125 countries in tropical and subtropical regions. Annually, approximately 390 million cases are reported worldwide, with 96 million manifesting clinical symptoms. (Thomas et al., 2022). The disease is not limited to tropical areas, as cases have been reported in the southern U.S. and in some European countries such as Italy, France, Greece, and Spain. (Mattar et al., 2019).

Figure 1 Aedes aegypti mosquito transmits dengue. 

The diagnosis of dengue is made through laboratory techniques, such as dengue-specific polymerase chain reaction with reverse transcription (PCR-RT), detection of the "non-structural" protein (NS1), evaluation of Immunoglobin type M- IgM, Immunoglobin type M - IgG, and virus isolation. In addition, clinical signs and symptoms play a vital role in the differential diagnosis. (Rubiano Godoy & Jiménez-Cendales, 2021)

Dengue (DENV) is part of a group of viruses known as the dengue serocomplex. It belongs to the genus Flaviviridae. The dengue serocomplex has different serotypes of different viruses: dengue type 1, 2, 3 and 4. They share similarities in structure and pathogenicity. In areas where dengue is common, all four virus serotypes circulate regularly in both endemic and highly endemic areas. These serotypes do not differ significantly from each other, as they are all capable of causing the disease known as dengue. This disease is of a viral nature and is entrenched in these regions. (Vargas-Navarro et al., 2021).

Dengue infection has a variety of clinical manifestations shared by other vector-borne viral infections, such as Chikungunya and Zika: (Figure 2).

  • Fever: Common symptoms of dengue fever last from 2 to 7 days.

  • Arthralgias: Pain in the joints is intense and limiting.

  • Myalgias: Pain in the muscles, intense and limiting.

  • Headache: May be severe and persistent.

  • Maculopapular rash: The skin may present the appearance of areas with red spots, which may vary in shape, some being flat and others with a small elevation.

  • Conjunctivitis: It is the inflammation of the conjunctiva, it may cause redness, itching and tearing.

  • Lymphadenopathy: Enlarged lymph nodes, which may be painful to the touch.

  • Leukopenia: A reduction of white blood cells in the blood and this may increase the chance of further infections.

  • Thrombocytopenia: A decrease of platelets in the blood increases the likelihood of experiencing bleeding.

  • Asthenia and Adynamia: Perception of weakness and lack of energy. (Rubiano Godoy & Jiménez-Cendales, 2021).

A complete diagnosis of dengue requires a complete medical evaluation.

Figure 2 Symptoms of dengue. 

According to WHO, it is divided as follows:

  • Outpatient treatment: Mentions patients with non-severe cases of dengue, where actions are implemented to manage the signs and symptoms. Self-care is promoted, avoiding self-medication, maintaining adequate hydration, and visiting the nearest health center to monitor temperature and vital signs.

  • Hospital treatment: Mentions the need for hospitalization of patients with hepatomegaly, hypotension, lethargy, increased capillary permeability, plasma leakage, dehydration, signs of shock and bleeding.

  • Intensive care: Depending on the severity of the clinical condition, the patient may require admission to an intensive care unit, where complications such as encephalitis, myocarditis, liver enlargement, fluid accumulation in the abdomen, fluid accumulation in the lungs (pleural effusion) and multiple organ failure may occur.

One of the ways to prevent is to avoid the formation of breeding sites, which reproduce in areas where water accumulates frequently. This is achieved by eliminating expendable objects that contain stagnant water, it is also recommended to cover well the tanks that contain water. It is important to keep yards and gardens tidy, weeded, and clean.

It is also suggested that people wear long sleeves and long pants and always use repellent.

In this context, the present research aims to compare different machine learning algorithms to develop an effective classification model for the identification of dengue virus cases. The application of machine learning algorithms in the field of health has become essential, allowing us to analyze complex data more efficiently than traditional modeling methods. (Yang Santos et al., 2023)

This research is of vital importance to increase the accuracy of diagnosis and promote timely treatment, optimizing the use of resources and contributing to scientific progress.

Previous studies, such as that of (Shaikh et al., 2023), highlight the usefulness of algorithms such as random forest and LightGBM for early prediction, providing accuracies of 76.9% and specificity of 87.9% at the plasma escape stage in dengue patients. Consistent with previous research, our work is framed for dengue case prediction and classification. The research of (Yang et al., 2023) highlights the value of random forest in identifying complex patterns and predicting 43.1% of severe cases. Other studies, such as (Handari et al., 2021), use methods such as Long Short-Term Memory (LSTM) to predict cases of dengue hemorrhagic fever with high accuracy. The Long Short-Term Memory (LSTM) method excelled with an accuracy of 0.04427%, offering the best predictions of cases in DKI Jakarta. These results are valuable for health authorities in the prevention and control of future outbreaks. Likewise, (Yavari Nejad & Varathan, 2021) state that they want to predict dengue outbreaks and improve accuracy with machine learning. They evaluated five models, highlighting a Bayesian network with a new risk factor, reaching 92.35% prediction accuracy. They conclude that identifying factors improves the prediction of dengue outbreaks, similarly, (Lim et al., 2020) explain that they wish to predict dengue epidemics through Bayesian regime shift models, using algorithms such as BAR and BRS. The BRS model demonstrated a higher predictive ability than time series models, identifying the influence of climatic factors on dengue transmission, with a MAPE of 5.43%. It is concluded that the regime shift models were more suitable for understanding the dynamics of dengue transmission, suggesting their value in epidemiology. In turn, (Li et al., 2022) say they seek to improve the accuracy of dengue case predictions with limited time series data. They used the Earth Engine (GEE) platform and the LSTM model to achieve this, obtaining a low mean square error (0.33%) and mean absolute percent error (0.28%) at week 12. This approach has great potential to forecast dengue risk effectively and practically, and its application in other regions or globally is suggested to strengthen disease prevention and control strategies, also, (Tanawi et al., 2021) note that they focus on predicting dengue cases in DKI Jakarta using climatic and previous data. Support vector regression models with linear and radial kernel were compared, with the linear being more accurate with a mean square error of 3.6678%. Variables such as temperature and cumulative rainfall correlated positively, while mean temperature correlated negatively, highlighting the influence of climate on dengue cases, furthermore, (Kaur & Sharma, 2023) argue that they wish to predict and diagnose dengue using various machine learning algorithms in Python. Where DT, CART and NB showed higher accuracy, sensitivity, specificity, and recall. A model that predicts dengue infection based on vital signs and symptoms was developed with greater than 90% accuracy and 90% accurate classification rate. Machine learning algorithms can extract hidden patterns in dengue data for accurate detection and improve disease management, finally, (Hamdani et al., 2022) that they seek to classify dengue patients using machine learning and symptoms as data, they compared algorithms such as KNN, RF, DT and SVM, finding that SVM was the most effective with 99.1% accuracy, recall and precision. They concluded that machine learning can be highly effective in diagnosing and predicting the type of dengue based on symptoms, which is crucial for proper treatment and early detection.

In this context, the present research contributes to the field by focusing on the comparative evaluation of algorithms, incorporating both technical aspects such as attribute selection and data partitioning. In addition, it seeks to identify specific patterns related to dengue, contributing to the growing understanding of this disease. The need for accurate classification of dengue cases not only has medical implications, but also extends to efficient resource management and informed public health decision making. The conclusions derived from this research could be essential to inform more effective health policies and prevention strategies, providing a solid foundation for future research in this field.

2. Materials and methods

Several essential resources were used to conduct the investigation. First, a dataset containing clinical information on 21,157 individuals presenting with dengue symptoms was used. This dataset, composed of truthful information, was essential to conduct a detailed analysis.

As for the development platform, Google Colab was chosen, which provides free access to computational resources. This platform not only facilitates real-time collaboration, but also includes pre-installed libraries, creating an efficient and accessible development environment.

For the execution of the analysis, a laptop with an Intel Core i5-1135G7 11th generation 2.40 GHz processor, 8.00 GB of RAM and Windows 10 operating system were used.

The programming language selected was Python, recognized for its specialized machine learning libraries. In addition, the clear and readable syntax of Python facilitated the development of the code, improving the understanding and interpretation of the results obtained in the study. Together, these elements formed the necessary technical basis for the research, enabling efficient and effective analysis of dengue-related data.

2.1. Dataset

In the first instance, it was necessary to build a dataset with which the machine learning algorithms should be implemented. It was considered essential to collect information from reliable sources in the department of Lambayeque, specifically in the field of public health. The focus was on collecting real and relevant data on dengue cases that have occurred in the first months of the year. This path was followed because, although there are datasets related to dengue available in platforms such as Kaggle and others, many of them are linked to data that are not relevant to this research. However, the interest lies in working with specific clinical data within the Lambayeque region.

Data collection was conducted in a public hospital, following strict confidentiality and privacy protocols. This approach guaranteed the construction of a reliable and valuable database, fundamental for the development of research. The creation of the dataset was governed by rigorous criteria to ensure accuracy and relevance in the information collected. These criteria are detailed below:

  1. Period: Refers to data collected during the months of January to July 2023. This choice is based on the observation that there was a significant increase in the number of dengue cases during this period.

  2. Outcome: The data used in this field are divided into two main categories: "confirmed" and " discarded". These results are obtained from the tests performed on patients, which allows for accurate classification of dengue cases.

  3. Age: People were classified into age groups following the technical regulations established by the Ministry of Health in Peru. These groups are:

    • Child: 0 to 11 years, 11 months, and 29 days.

    • Adolescent: 12 to 17 years, 11 months, and 29 days.

    • Youth: 18 to 29 years, 11 months, and 29 days.

    • Adult: 30 to 59 years 11 months and 29 days

    • Older adult: 60 years and older

  4. Sex: Dengue cases were classified into two categories: Female and male, to analyze the differences in the incidence of dengue according to gender.

  5. Symptoms: Dengue-related symptoms were considered. These symptoms can vary in severity, from mild to severe, and even life-threatening in some cases. Typical symptoms of dengue usually manifest 4 to 10 days after the bite of an infected mosquito considering fever, headache, eye pain, bone pain, nausea, and rash.

  6. Imported: We have considered dengue cases contracted outside the Lambayeque region, which allows us to analyze the spread of the virus from other areas.

  7. Autochthonous: We have considered dengue cases that originated within the Lambayeque region. This is essential to understand the local dynamics of the disease and its impact on the community.

After establishing these criteria, we proceeded to the selection and collection of relevant data. Table 1 shows that the result was a robust and representative dataset with 21,157 cases, including confirmed and discarded cases. It was then transformed into a .csv format to facilitate model training and perform advanced analyses, thus ensuring the quality and usefulness of the dataset for research. This meticulous approach to dataset construction supports the robustness and relevance of the results obtained in the study.

Table 1 Dataset structure. 

Period Outcome Age Sex Symptoms Imported Autochthonous
Fever Headache Eye pain Bone pain Nausea Rash
January confirmed 18_29 Female Yes Yes Yes Yes No Yes Yes No
January discarded 0_11 Female Yes Yes Yes No Yes No No Yes
January discarded Older60 Female No No Yes Yes No Si No Yes

2.2. Application of machine learning algorithms

A crucial phase of our research involves conducting a systematic literature review in the field of machine learning algorithms. This thorough analysis has as its central objective to provide us with an updated view of the state of the art of research in the exciting domain of machine learning.

This review becomes a fundamental tool for identifying algorithms that possess significant relevance and are well suited to solving specific problems in various domains. A key component of this review involves the search and analysis of studies published in recognized scientific databases, such as Scopus, PubMed and Science Direct.

This approach provides us with highly valuable information on which algorithms stand out as the most effective in addressing specific tasks, allowing us to make more informed decisions in future machine learning projects. We have precisely defined a set of fundamental criteria that will guide our exploration and evaluation in the field of machine learning applied to dengue classification. These criteria are essential to focus on key aspects of interest and obtain meaningful results. The established criteria are as follows:

  • Algorithms used in dengue classification

  • We will explore and analyze specific algorithms used in previous research related to dengue classification. This will allow us to identify trends and successful approaches used by the scientific community.

  • Performance evaluation of metrics used in learning algorithms for dengue classification:

In Table 2, we will critically analyze the performance metrics used in previous studies to evaluate the effectiveness of algorithms in dengue classification. This analysis will contribute to the identification of robust and reliable metrics to identify the algorithm that is most efficient in terms of training time.

Table 2 Algorithms with systematic review yields. 

Article Algorithm Precision Accuracy Recall Sensitivity Specificity
(Kapoor et al., 2022; Li et al., 2022 Saleem et al., 2022; Stolerman et al., 2019; Suhaeri et al., 2018) Decision tree (DT) 79% 80% 81%
(Kaur & Sharma, 2023; Mudele et al., 2021; Rahman & Prasetiyowati, 2022) K-Nearest-neighbor (KNN) 80% 85%
(Aguas et al., 2019; Kapoor et al., 2022; Lim et al., 2020; Macedo Hair et al., 2019; Saleem et al., 2022; Sanchez-Gendriz et al., 2022; Shenoy et al., 2022; Rahman et al., 2021; Yang et al., 2023) Random forest (RF) 86.18% 99,1% 99,1% 90% 90%
(Gangula et al., 2021; Han et al., 202; Hamdani et al., 2022; Hoyos et al., 2022; Ismail et al., 2022; Kapoor et al., 2022; Mello-Román, et al., 2019; Ozer et al., 2021; Rahman & Prasetiyowati, 2022; Rahman et al., 2021; Rustam et al., 2022; Saleem et al., 2022; Shaikh et al., 2023; Stolerman et al., 2019; Yavari Nejad & Varathan, 2021) Support vector machine (SVM) 90.90% 98% 98% 90% 90%
(Han et al., 2021; Kapoor et al., 2022; Rahman et al., 2021; Shenoy et al., 2022) Logistic Regression (LR) 82% 88% 88%
(Han et al., 2021; Rahman et al., 2021; Zargari Marandi et al., 2023) Naive Bayes (NB) 83% 95% 95%
(Choubey et al., 2022; Han et al., 2021; Nadda et al., 2022; ; Ozer et al., 2021) Long Short-Term Memory (LSTM) 83% 96%
(Fernandes et al., 2021; Matuszewski & Sintorn, 2021; Ozer et al., 2021; Rustam et al., 2022; Zhao et al., 2023) Convolutional neural network(CNN) 84,5%
(Hoyos et al., 2022; Ismail et al., 2022; Gendriz et al., 2022; Mello-Román, et al., 2019; Rahman et al., 2021; Sanchez- Ozer et al., 2021; Shaikh et al., 2023; Zargari Marandi et al., 2023) Artificial neural networks (ANN) 94.38% 97.8% 97.8% 96% 97%
(Handari et al., 2021; Mudele et al., 2021; Sukama et al., 2020; Zhao et al., 2023) Recurrent neural networks (RNN) 79% 80% 81%
(Kaur & Sharma, 2023; Ozer et al., 2021; Santos et al., 2022) Linear discriminant analysis (LDA) 80% 85%

Based on te criteria, the Table 3 is shown a list of selected algorithms as elaborated to train them and, thus, compare the results obtained.

Table 3 Selected algorithms 

Algorithm Precision Recall Specificity
1 Random forest (RF) 86.18% 99,1% 90%
2 Support vector machine (SVM) 90.90% 98% 98%
3 Artificial neural networks (ANN) 94.38% 97.8% 97.8%

The metrics chosen to evaluate these algorithms are crucial to accurately measure their performance. The selected metrics and their relevance in the context of dengue classification are detailed below:

  • Precision: Plays a critical role in providing the percentage of values classified as positive that are positive. In the medical setting, this metric provides a clear view of how accurately actual cases of the disease are detected among all cases classified as positive. It is essential to ensure accuracy in identifying dengue cases.

  • Recall: Provides insight into how many positives are correctly classified. In the context of health, it determines the ability of the algorithm to detect disease among sick individuals. It is a vital metric for assessing the sensitivity of the algorithm in identifying dengue cases, ensuring effective disease detection.

  • Specificity: Provides information on how many negative values are correctly classified. In a medical context, it refers to the ability to correctly identify healthy patient cases among the group of individuals who are effectively healthy. It minimizes false positives and is crucial to ensure the reliability of the algorithm in identifying individuals not affected by dengue.

In terms of infrastructure and tools used, the Google Colab environment was chosen for algorithm training. This environment offers free access to a variety of computing resources, such as storage, memory, processing power, graphics processing units (GPU) and tensor processing units (TPU). In addition, by using the Python programming language, an efficient and flexible implementation of the algorithms is ensured. As previously mentioned, support vector, random forest and artificial neural network algorithms were carefully selected.

a. Support vector machine

Figure 3 shows the implementation of the support vector machine (SVM) algorithm, begins with the loading of data that includes detailed information on several dengue cases, covering the period of incidence, test results, patient ages, gender, presenting symptoms, and the distinction between imported and autochthonous cases.

Figure 3 Architecture of support vector machine. Own elaboration. 

The panda’s library is imported into Python for the purpose of loading data from a CSV file named "dataset.csv". The specific location of that file is defined in the variable 'path', which is used as an argument in the function 'pd.read_csv()'. This function, in turn, reads the CSV file, transferring the data to a dataframe named 'data'. Subsequently, the 'head(5)' method is used to display the first 5 rows of the dataframe, allowing users to get a quick impression of the structure and content of the newly imported data.

Period Outcome Age Sex Fever Headache Eye pain Bone pain Nausea Rash Imported Autochthonous
0 1 1 3 1 1 1 1 1 0 1 1 0
1 1 0 1 1 1 1 1 0 1 0 0 1
2 1 0 5 1 0 0 1 1 0 1 0 1
3 1 0 5 0 1 0 0 0 0 0 1 0
4 1 0 4 0 1 1 0 1 1 1 1 0

Then the transformation of categorical and binary variables to numeric variables is performed using the fit_transform method of LabelEncoder (le). This step is essential to allow the support vector machine to operate with these variables.

The predictor variables and the target variable for the model are defined. The set of predictor variables, denoted as X, is composed of various characteristics, such as 'period', 'age', 'sex', 'fever', 'headache', 'eyes pain', 'bone pain','nausea', 'rash', 'imported' and 'autochthonous'. These features represent the attributes that will be used to make predictions about the model output. On the other hand, the target variable, represented by Y, is associated with the 'outcome' column. This variable contains the class labels that the SVM model will seek to predict during the training and evaluation process.

Next, the splitting of the dataset into training and test sets is performed using the train_test_split function. It is important to note that 30% of the dataset is allocated for the test set, while 70% is allocated for the training set. This proportion is determined by the parameter test_size=0.3. In addition, the parameter random_state=2023 is used for the purpose of establishing a random seed and thus ensuring the reproducibility of the experiment in future runs.

Next, an SVM with a linear kernel is created using the SVC() class. The SVM model is trained using the training set using the instruction svm.fit(X_train, y_train). The evaluation of the model is performed with the test set (X_test), where the SVM classifies the unobserved data, and the predictions are compared with the actual labels (y_test).

Various evaluation metrics, such as precision, recall and specificity, are calculated, providing detailed information on the performance of the model in terms of classification quality. (See Appendix).

b. Random forest

Figure 4 shows the implementation of the random forest model starts with data loading, followed by the essential transformation of categorical and binary variables to numerical variables. This step is fundamental to ensure that the random forest model can efficiently manage the variables during the training and prediction process. Next, the data set is split into training and test sets using the train_test_split function.

Figure 4 Random forest architecture. Own elaboration. 

Once the preprocessing is completed, the random forest model is generated using the randomforestclassifier() class. This model is trained with the training set using the rf.fit(X_train, y_train) instruction. This step allows the model to learn patterns and relationships in the training data, preparing it to make predictions about unseen data. Model evaluation is conducted using the test set (X_test), where the random forest model classifies the unobserved data, and the predictions are compared with the actual labels (y_test). Various evaluation metrics, such as precision, recall and specificity, are calculated to provide a detailed understanding of the model performance.

Visualizing an individual tree using tree.plot_tree (Figure 5) provides a detailed understanding of the structure and decisions made by that specific tree within the random forest. The graphical representation is saved in an image file for future analysis and reference. (See Appendix).

Figure 5 Random forest was generated in the research. Own elaboration. 

c. Artificial neural network

Figure 6 shows the implementation of the artificial neural network, starts with the loading of the data mentioned above. Then, the transformation of categorical and binary variables to numerical variables is performed, an essential step to allow the neural network to process and learn from these variables.

Figure 6 Artificial neural networks. Own elaboration. 

Next, the data set is split into training and test sets using the train_test_split function, ensuring an accurate evaluation of the model on data not seen during the training process.

Subsequently, the Multilayer Perceptron (MLP) neural network model is built and trained using the MLPClassifier class from the scikit-learn library.

The Figure 7 shows the network architecture is specified with two hidden layers: One composed of 64 neurons and the other of 32 neurons, giving the model a certain complexity to capture patterns in the data. The model is trained with the training set using the fit method.

Figure 7 Architecture of an artificial neural network. Own elaboration. 

The evaluation of the predictive capability of the model is performed using the test set. Predictions are generated using the predict method, and evaluation metrics such as accuracy, recall and specificity are calculated. The corresponding code is presented below:

It is important to note that the ReLU activation function is employed by default in the hidden layers of the neural network. The choice of activation function is crucial, and ReLU (Rectified Linear Unit) is commonly used for its ability to manage gradient fading problems and its computational efficiency.

In addition, a maximum number of iterations (max_iter) is set for the model training process. This parameter controls the maximum number of epochs or iterations that the model will perform during training. Limiting the number of iterations can be useful to avoid overfitting and improve training efficiency. (See appendix).

2.3. Results

Table 4 presents the computational resources used by each machine learning algorithm during its execution. The support vector machine algorithm used 35.4% of the CPU, consumed 1.06 GB of RAM and exhibited a response time of 0.01 seconds. On the other hand, random forest used 21% of the CPU, consumed 1 GB of RAM and presented a response time of 0.02 seconds. Finally, artificial neural network demanded 62.3% of the CPU, used 1.32 GB of RAM and registered a response time of 0.05 seconds. (Figure 8).

Table 4 Measured CPU consumption, ram memory and response time used by the three machine learning algorithms. 

Algorithm CPU consumption RAM consumption Response time
Support vector machine 35.4% 1.06 GB 0.011 seg
Random forest 21.0% 1 GB 0.024 seg
Artificial neural network 62.3% 1.32 GB 0.051 seg

Figure 8 Measures of CPU consumption, RAM memory and response time used by the three machine learning algorithms. Own elaboration 

Next, Table 5 presents the results obtained according to the performance metrics of each algorithm for dengue classification.

Table 5 Performance of the three machine learning algorithms. 

Algorithm Precision Recall Specificity
Support vector machine 83.38% 99.05% 8.47%
Random forest 84.94% 92.88% 46.9%
Artificial neural network 86.47% 92.91% 55.65%

The results were obtained by evaluating three classification models: Support vector machine, random forest, and artificial neural network, implemented to classify dengue (Figure 9). In the first instance, the accuracy of the models was compared, revealing that artificial neural network (ANN) showed an outstanding performance with 86.47%, positioning itself as the most accurate in the classification of dengue. It is followed by the random forest algorithm with an accuracy of 84.94%, while the support vector machine presents the lowest accuracy with 83.38%.

Figure 9 Performance evaluation of the machine learning algorithms proposed in our research. Own elaboration. 

In the analysis of model recall, support vector machine leads with a performance of 99.05%, evidencing its ability to identify and recover a high percentage of positive cases. Random forest follows with a recall of 92.88%, and artificial neural network presents the lowest recall with 92.91%.

Finally, the comparison of the specificity of the models shows that artificial neural network exhibits the best performance with 55.65%, indicating its ability to correctly identify and classify a high percentage of negative cases in relation to the total number of negative cases. Random forest obtains a specificity of 46.9%, while support vector machine presents the lowest specificity with 8.47%.

2.4. Discussion

The results obtained in this study, focused on a comparative analysis of machine learning algorithms for dengue classification, offer valuable insights that contribute to the advancement of diagnostic tools in clinical practice. The application of various machine learning algorithms has yielded encouraging results in terms of accuracy and recall in dengue classification.

The analysis revealed that the support vector machine algorithm demonstrated a sensitivity of 99.05%, outperforming other approaches. This feature facilitates resource optimization by identifying the most efficient algorithms, contributes to the identification of features and risk factors associated with dengue, and supports clinical decision making, while contributing to scientific progress in the field of medicine.

However, it is crucial to address the limitations identified during the study. The dataset has limitations in the generality of symptom information, the binary categorization of outcomes that simplifies clinical complexity, and the age grouping that may not capture intragroup variability. The autochthonous/imported distinction could be more specific, and the monthly categorization may lack sufficient temporal detail. Data quality and consistency, biases, and ethical considerations are issues to be addressed to improve the reliability and usefulness of the dataset.

Comparing the results with previous research, it is noted that Mello-Roman et al. reported a recall of 93% for the support vector machine algorithm, which is lower than the figure obtained in our research. In their study, they used a dataset of real patients with a previous diagnosis of dengue fever, extracted from the Paraguayan public health system. Ozer et al. reported that the support vector machine algorithm had a recall of 76%. In their study, they used SISA and SISAL datasets that include demographic information, past medical histories, and symptom data.

The practical implications derived from the results indicate that the implementation of machine learning algorithms has the potential to significantly improve dengue classification. However, the transition from the research setting to clinical application poses additional challenges, such as integration with existing medical information systems and validation of results in real-world clinical settings.

This analysis provides significant insights into the efficiency of machine learning algorithms in dengue classification, highlighting the importance of future research that addresses specific challenges or supports the clinical application of these promising tools.

3. Conclusions

This comparative study of machine learning algorithms for dengue classification has provided valuable insights into the performance and effectiveness of different methodologies. The results highlight the significant potential of these tools in improving diagnostics and efficient identification of dengue cases. The main findings are presented below: Support vector machine (SVM) performance: The SVM algorithm proved to be sensitive, reaching a sensitivity of 99.05%. This ability to accurately identify positive cases highlights the effectiveness of SVM in the classification of dengue cases. Despite encouraging results, limitations are recognized in the generality of symptom information, binary categorization of results, and age grouping. These should be addressed in future research to improve the quality and utility of the data set. Comparison with previous studies reveals variations in results, highlighting the importance of considering the particularities of each data set and context. Variability in results highlights the need for additional studies to validate and generalize findings.

Acknowledgements

The authors express their gratitude to the reviewers for their dedication in reviewing this article and for their constant comments, which have contributed to improving the quality of this work.

References

Aguas, R., Dorigatti, I., Coudeville, L., Luxemburger, C., & Ferguson, N. M. (2019). Cross-serotype interactions and disease outcome prediction of dengue infections in Vietnam.Scientific Reports, 9(1), 9395. https://doi.org/10.1038/s41598-019-45816-6 [ Links ]

Santos, M. C., Viana, J. L., Monteiro, J. D., Freire, R. C., Freitas, D. L., Câmara, I. M., ... & Lima, K. M. (2022). Infrared spectroscopy (NIRS and ATR-FTIR) together with multivariate classification for non-destructive differentiation between female mosquitoes of Aedes aegypti recently infected with dengue vs. uninfected females.Acta Tropica,235, 106633. https://doi.org/10.1016/j.actatropica.2022.106633 [ Links ]

Choubey, S., Barde, S., & Badholia, A. (2022). Enhancing the prediction efficiency of virus borne diseases using enhanced backpropagation with an artificial neural network.Measurement: Sensors,24, 100505. https://doi.org/10.1016/j.measen.2022.100505 [ Links ]

Fernandes, M. S., Cordeiro, W., & Recamonde-Mendoza, M. (2021). Detecting Aedes aegypti mosquitoes through audio classification with convolutional neural networks.Computers in Biology and Medicine,129, 104152. https://doi.org/10.1016/j.compbiomed.2020.104152 [ Links ]

Gangula, R., Thirupathi, L., Parupati, R., Sreeveda, K., & Gattoju, S. (2021). Ensemble machine learning based prediction of dengue disease with performance and accuracy elevation patterns. https://doi.org/10.1016/j.matpr.2021.07.270 [ Links ]

Macedo Hair, G., Fonseca Nobre, F., & Brasil, P. (2019). Characterization of clinical patterns of dengue patients using an unsupervised machine learning approach.BMC infectious diseases,19, 1-11. https://doi.org/10.1186/s12879-019-4282-y [ Links ]

Hamdani, H., Hatta, H. R., Puspitasari, N., Septiarini, A., & Henderi, H. (2022). Dengue classification method using support vector machines and cross-validation techniques.IAES International Journal of Artificial Intelligence,11(3), 1119. [ Links ]

Han, T. T., Pham, H. Y., Nguyen, D. S. L., Iwata, Y., Do, T. T., Ishibashi, K., & Sun, G. (2021). Machine learning based classification model for screening of infected patients using vital signs.Informatics in Medicine Unlocked,24, 100592. https://doi.org/10.1016/j.imu.2021.100592 [ Links ]

Handari, B. D., Niman, I., Hasan, A., Purba, J. R., & Hertono, G. F. (2021). Comparation of Elman neural network, long short-term memory, and gated recurrent unit in predicting dengue hemorrhagic fever at DKI Jakarta.Communications in Mathematical Biology and Neuroscience, 2021. Article ID 87 [ Links ]

Hoyos, W., Aguilar, J., & Toro, M. (2022). An autonomous cycle of data analysis tasks for the clinical management of dengue.Heliyon, 8(10). https://doi.org/10.1016/j.heliyon.2022.e10846 [ Links ]

Ismail, S., Fildes, R., Ahmad, R., Ali, W. N. W. M., & Omar, T. (2022). The practicality of Malaysia dengue outbreak forecasting model as an early warning system.Infectious Disease Modelling, 7(3), 510-525. https://doi.org/10.1016/j.idm.2022.07.008 [ Links ]

Kapoor, R., Ahuja, S., & Kadyan, V. (2022). Machine Learning Based Classification Algorithm for Classification of Dengue (Dengue Fever-DF, Dengue Harmonic Fever-DHF, Serve Dengue-SD).ECS Transactions,107(1), 4659. https://doi.org/10.1149/10701.4659ecst [ Links ]

Kaur, S., & Sharma, S. (2023). Comparative Analysis of Machine Learning Classifiers on Forecasting Dengue Fever Infection. InRecent Developments in Electronics and Communication Systems(pp. 492-497). IOS Press. https://doi.org/10.3233/ATDE221302 [ Links ]

Li, Z., Gurgel, H., Xu, L., Yang, L., & Dong, J. (2022). Improving dengue forecasts by using geospatial big data analysis in google earth engine and the historical dengue information-aided long short term memory modeling.Biology,11(2), 169. https://doi.org/10.3390/biology11020169 [ Links ]

Lim, J. T., Dickens, B. S., Haoyang, S., Ching, N. L., & Cook, A. R. (2020). Inference on dengue epidemics with Bayesian regime switching models.PLoS computational biology,16(5), e1007839. https://doi.org/10.1371/journal.pcbi.1007839 [ Links ]

Mattar, S., Montero, J., & González, M. (2019). La historia del dengue aún no termina.Revista MVZ Córdoba,24(2), 7177-7179. https://dialnet.unirioja.es/servlet/articulo?codigo=7734473Links ]

Matuszewski, D. J., & Sintorn, I. M. (2021). TEM virus images: Benchmark dataset and deep learning classification.Computer Methods and Programs in Biomedicine,209, 106318. https://doi.org/10.1016/j.cmpb.2021.106318 [ Links ]

Mello-Román, J. D., Mello-Román, J. C., Gomez-Guerrero, S., & García-Torres, M. (2019). Predictive models for the medical diagnosis of dengue: a case study in Paraguay.Computational and mathematical methods in medicine,2019(1), 7307803. https://doi.org/10.1155/2019/7307803 [ Links ]

Mudele, O., Frery, A. C., Zanandrez, L. F., Eiras, A. E., & Gamba, P. (2021). Dengue vector population forecasting using multisource earth observation products and recurrent neural networks.IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,14, 4390-4404. https://doi.org/10.1109/JSTARS.2021.3073351 [ Links ]

Nadda, W., Boonchieng, W., & Boonchieng, E. (2022). Influenza, dengue and common cold detection using LSTM with fully connected neural network and keywords selection.BioData Mining,15(1), 5. https://doi.org/10.1186/s13040-022-00288-9 [ Links ]

Ozer, I., Cetin, O., Gorur, K., & Temurtas, F. (2021). Improved machine learning performances with transfer learning to predicting need for hospitalization in arboviral infections against the small dataset.Neural Computing and Applications,33, 14975-14989. https://doi.org/10.1007/s00521-021-06133-0 [ Links ]

Rahman, M. S., Pientong, C., Zafar, S., Ekalaksananan, T., Paul, R. E., Haque, U., ... & Overgaard, H. J. (2021). Mapping the spatial distribution of the dengue vector Aedes aegypti and predicting its abundance in northeastern Thailand using machine-learning approach.One Health,13, 100358. https://doi.org/10.1016/j.onehlt.2021.100358 [ Links ]

Rahman, A., & Prasetiyowati, S. (2022). Performance analysis of the hybrid voting method on the classification of the number of cases of Dengue Fever.International Journal on Information and Communication Technology (IJoICT), 8(1), 10-19. [ Links ]

Rubiano Godoy, M. M., & Jiménez Cendales, B. S. (2021). Validez diagnóstica de las pruebas clínicas para el diagnóstico diferencial de Dengue en población pediátrica.Pediatría,53(4), 122-130. https://doi.org/10.14295/rp.v53i4.166 [ Links ]

Rustam, F., Reshi, A. A., Aljedaani, W., Alhossan, A., Ishaq, A., Shafi, S., ... & Rupapara, V. (2022). Vector mosquito image classification using novel RIFS feature selection and machine learning models for disease epidemiology.Saudi Journal of Biological Sciences,29(1), 583-594. https://doi.org/10.1016/j.sjbs.2021.09.021 [ Links ]

Saleem, M., Ali, S., Bilal, M., Safdar, K., & Hassan, M. (2022). Development of multivariate classification models for the diagnosis of dengue virus infection.Photodiagnosis and Photodynamic Therapy,40, 103136. https://doi.org/10.1016/j.pdpdt.2022.103136 [ Links ]

Sanchez-Gendriz, I., de Souza, G. F., de Andrade, I. G., Neto, A. D. D., de Medeiros Tavares, A., Barros, D. M., ... & de Medeiros Valentim, R. A. (2022). Data-driven computational intelligence applied to dengue outbreak forecasting: a case study at the scale of the city of Natal, RN-Brazil.Scientific reports,12(1), 6550. https://doi.org/10.1038/s41598-022-10512-5 [ Links ]

Shaikh, M. S. G., SureshKumar, B., & Narang, G. (2023). Development of optimized ensemble classifier for dengue fever prediction and recommendation system.Biomedical Signal Processing and Control,85, 104809. https://doi.org/10.1016/j.bspc.2023.104809 [ Links ]

Shenoy, S., Rajan, A. K., Rashid, M., Chandran, V. P., Poojari, P. G., Kunhikatta, V., ... & Thunga, G. (2022). Artificial intelligence in differentiating tropical infections: A step ahead.PLoS Neglected Tropical Diseases,16(6), e0010455. https://doi.org/10.1371/journal.pntd.0010455 [ Links ]

Thomas, S. J., Rothman, A. L., Srikiatkhachorn, A., & Kalayanarooj, S. (2022). Dengue virus infection: Prevention and treatment.UpToDate. Waltham MA: UpToDate Inc. [ Links ]

Stolerman, L. M., Maia, P. D., & Kutz, J. N. (2019). Forecasting dengue fever in Brazil: An assessment of climate conditions.PloS one,14(8). https://doi.org/10.1371/journal.pone.0220106 [ Links ]

Suhaeri, S., Mohd Nawi, N., & Fathurahman, M. (2018). Early Detection of Dengue Disease Using Extreme Learning Machine.International Journal on Advanced Science, Engineering and Information Technology, 8(5), 2219-2224. https://doi.org/10.18517/ijaseit.8.5.5006 [ Links ]

Sukama, Y., Hertono, G. F., Handari, B. D., & Aldila, D. (2020). Comparing activation functions in predicting dengue hemorrhagic fever cases in DKI Jakarta using recurrent neural networks. InAIP Conference Proceedings(Vol. 2296, No. 1). AIP Publishing. https://doi.org/10.1063/5.0030456 [ Links ]

Tanawi, I. N., Vito, V., Sarwinda, D., Tasman, H., & Hertono, G. F. (2021). Support vector regression for predicting the number of dengue incidents in DKI Jakarta.Procedia Computer Science,179, 747-753. https://doi.org/10.1016/j.procs.2021.01.063 [ Links ]

Vargas-Navarro, A., Bustos-Vázquez, E., Salas-Casas, A., Ruvalcaba-Ledezma, J. C., & Imbert-Palafox, J. L. (2021). Infección por Dengue, un problema de salud pública en México.Journal of Negative and No Positive Results, 6(2), 293-306. https://dx.doi.org/10.19230/jonnpr.3771 [ Links ]

Yang Santos, C. Y., Tuboi, S., de Abreu, A. D. J. L., Abud, D. A., Neto, A. A. L., Pereira, R., & Siqueira, J. B. (2023). A machine learning model to assess potential misdiagnosed dengue hospitalization.Heliyon, 9(6). https://doi.org/10.1016/j.heliyon.2023.e16634 [ Links ]

Yang, J., Mosabbir, A. A., Raheem, E., Hu, W., & Hossain, M. S. (2023). Demographic characteristics, clinical symptoms, biochemical markers and probability of occurrence of severe dengue: A multicenter hospital-based study in Bangladesh.PLOS Neglected Tropical Diseases,17(3). [ Links ]

Yavari Nejad, F., & Varathan, K. D. (2021). Identification of significant climatic risk factors and machine learning models in dengue outbreak prediction.BMC Medical Informatics and Decision Making,21(1), 141. https://doi.org/10.21203/rs.2.15755/v6 [ Links ]

Zargari Marandi, R., Leung, P., Sigera, C., Murray, D. D., Weeratunga, P., Fernando, D., ... & MacPherson, C. R. (2023). Development of a machine learning model for early prediction of plasma leakage in suspected dengue patients.PLOS Neglected Tropical Diseases,17(3). https://doi.org/10.1371/journal.pntd.0010758 [ Links ]

Zhao, X., Li, K., Ang, C. K. E., & Cheong, K. H. (2023). A deep learning based hybrid architecture for weekly dengue incidences forecasting.Chaos, Solitons & Fractals,168. https://doi.org/10.1016/j.chaos.2023.113170 [ Links ]

Funding

The authors received no specific funding for this work.

Appendix A. Support vector machine (SVM)

Its goal is to find an optimal hyperplane in a high dimensional space that effectively separates data classes. The SVM architecture is based on defining a hyperplane represented by the equation w⋅x+b=0, where w is the vector of weights and b is the bias term. During training, SVM seeks to maximize the margin between this hyperplane and the nearest support vectors, using the Hinge Loss function to penalize misclassifications. In addition, SVM uses a regularization parameter C to control the trade-off between maximizing the margin and minimizing the classification errors in the training set. To manage nonlinear data, SVM employs the kernel trick, which maps the data to a higher dimensional space where classes can be linearly separated.

Appendix B. Random forest

Machine learning algorithm that uses multiple decision trees to improve predictive accuracy. Each tree is trained on a random subset of data and features, which reduces overfitting and improves model generalization. For classification problems, the most frequent class among the trees is chosen; for regression problems, the output of the trees is averaged. Random forest is robust, scalable, and efficient for complex data sets. Adjusting hyperparameters such as the number of trees and maximum depth is crucial to optimize its performance. This method is widely used due to its versatility and satisfactory performance in a variety of machine learning applications.

Appendix C. Artificial neural network (ANN)

An artificial neural network is a machine learning model composed of interconnected units called neurons. It is organized in layers, including an input layer, one or more hidden layers that process data, and an output layer that generates predictions or results. During training, the weights of the connections between neurons are adjusted to minimize the difference between model predictions and desired outputs. ANNs are versatile and can be applied to classification, regression, natural language processing and computer vision problems, among others. They are powerful tools for learning complex patterns from data and making meaningful inferences in various machine learning applications.

Received: December 27, 2023; Accepted: June 17, 2024; Revised: October 31, 2024

Corresponding author. E-mail address: echepeyolandade@uss.edu.pe (Y. V. Exebio-Chepe).

Conflict of interest

The authors have no conflicts of interest to declare

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License