Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19 Surveillance Dataset

*Hamza Abubakar and Muntari Idris*

## **Abstract**

The Boolean Satisfiability Problem (BSAT) is one of the crucial decision problems in the fields of computing science, operation research, and mathematical logic that is resolved by deciding whether or not a solution to a Boolean formula exists. When there is a Boolean variable allocation that induces the Boolean formula to yield TRUE, then the SAT instance is satisfiable. The main purpose of this chapter is to utilize the optimization capacity of the Lyapunov energy function of Hopfield neural network (HNN) for optimal representation of the Random Satistibaility for COVID-19 Surveillance Data Set (CSDS) classification with the aim of extracting the relationship of dominant attributes that contribute to COVID-19 detections based on the COVID-19 Surveillance Data Set (CSDS). The logical mining task was carried based on the data mining technique of the energy minimization technique of HNN. The computational simulations have been carried using the different number of clauses in validating the efficiency of the proposed model in the training of COVID-19 Surveillance Data Set (CSDS) for classification. The findings reveals the effectiveness and robustness of k satisfiability reverse analysis with Hopfield neural network in extracting the dominant attributes toward COVID-19 Surveillance Data Set (CSDS) logic.

**Keywords:** artificial neural network, Hopfield neural network, random satisfiability, reverse analysis, logic mining

## **1. Introduction**

The COVID-19 pandemic is still having a significant impact on people's health and quality of life all around the world. Effectively identifying and isolating affected people is the most crucial step in stopping COVID-19. Clinical medicine can identify COVID-19 instances thanks to the discovery that patients with the infection exhibit anomalies in CT imaging. Additionally, CT scans can be used to determine the severity of an illness, which is useful for selecting the right course of action. Many deep learning-based COVID-19 case identification techniques have recently been put out, some of which have had good success. The biggest obstacle to increasing COVID-19's

classification accuracy is currently the small number of training instances and annotations. Additionally, due to the poor contrast of CT scans, deep learning-based classification systems struggle to comprehend ambiguous and imprecise information, such as pixels near boundaries and pictures related to COVID-19 instances. We suggest a belief function-based classification network to categorize COVID-19 cases using semi-supervised learning to address the aforementioned issues, and we acknowledge the research community's open-source COVID-19 dataset [1–3].

Neural networks are used extensively in many fields of study originated in mathematical neurobiology. This can be because these networks are attempts to simulate human brain capabilities. Neural networks have been utilized since the last decade as a theoretically sound alternative to traditional statistical models. It is also effective in classifying data into identifiable groups or characteristics. When used in a hybrid framework with the many forms of predictive neural networks, the classification of neural networks becomes very efficient. Machine-learning methods including artificial neural networks (ANN) have been used in recent times as tools for decision, prediction, classification, and diagnosis [4–11]. It has been used in medical approaches to digenesis, predict, and detect diseases using effects on development, such as fibrosis prediction, cirrhosis, and prediction of response therapy in patients with hepatitis C [12–21].

Artificial neural network (ANN) models have been widely used in data mining for a wide range of medical, science, engineering, and industry issues. Logic mining is one of the key data mining fields. It has been shown that knowledge in a logical or symbolic form can be represented [22]. Recent data mining studies have led to the emergence of various types of artificial neural network models such as Hopfield neural network (HNN), Radial Basis Neural Network, Convolution neural network, and other machine learning tools that can foster logic mining through knowledge extraction process [23, 24]. Consequently, data mining practitioners assimilate multidisciplinary knowledge such as Artificial neural networks, mathematics, artificial intelligence, machine learning, and statistics to create logic for data mining techniques for finding underlying information based on the behavior of databases or data sets. Therefore, data mining can be improved in the neural network to cater to various problems. As for this work, the incorporation of Random *k* Satisfiability (RANkSAT) propositional logic is utilized with the proposed to introduce a comprehensive model to solve real-life applications. Artificial neural network (ANN) possesses a comprehensive structure of training and testing stages thus, ANN has emerged as one of the most efficient tools extend in finding patterns and extracting information to solve real-life applications. Therefore, we presume that this research contributes to amplifying the efforts to enhance the capability of fundamental ANN with the inclusion of a recurrent type of network known as Hopfield neural network (HNN). Propositional logic based on Random-k Satisfiability (RANkSAT) is considered a suitable approach to represent logical rules in neural network for optimal classification of real-world problem. By considering only maximum of three literals per clause, the logical complexity in learning the relationship between the variables in real-life problem decreases.

In this work, Random *k* Satisfiability-based Reverse Analysis method (RAN*k*SATRA) has been proposed to obtain the logical COVID-19 Surveillance Data Set (CSDS). The aforementioned studies, which offer a different perspective on describing the real data in the form of logical representation, have demonstrated the usefulness of diverse logic programming in HNN. In order to depict the behavior of the COVI-19 data sets, we require a very well, intelligent logical rule. However, there

## *Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*

is no effort to bridge RANkSAT logical representation in Hopfield neural network for COVID-19 classification. This is crucial because an artificial neural network algorithm can cater variation and randomness in COVID-19 analysis and larger searching space. Therefore, the contributions of this research are presented as follows: The contributions of this work are as follows: (a) to convert the COVID-19 surveillance data set (CSDS) into intelligent systematic form based on RAN*k*SAT logical clauses. (b) To propose random *k* satisfiability reverse analysis method as an alternative approach in extracting the relationships between the factors or attributes that contribute to the knowledge extraction based on COVID-19 surveillance data set (CSDS) obtained from a UCI machine learning repository. (c) To assess the capability and accuracy of three variants of the satisfiability proposed method based on Random k satisfiability, Random maximum k satisfiability, and Horn k satisfiability logical representation in completing the COVID-19 surveillance data set (CSDS) extraction with a different number of clauses. The performance evaluation metrics will be adopted to evaluate the effectiveness of both the proposed method and logical representations as an alternative data extraction method to the COVID-19 data set. The general implementation of random *k* satisfiability reverses the analysis method and HNN in extracting logic in COVID-19 data. The construction of our proposed model, would exhibit better performance in the training stage and successfully interprets real-life datasets to detect which factors are more prominent than others that contribute to the optimization problems. Our findings showed that the proposed model executing the best performance in terms of attaining small errors and efficient computational time compared to other existing models. This study has been organized as follows. Material and method including, Random *k* Satisfiability Logic, Hopfield Neural Network (HNN), and random *k* satisfiability-based reverse analysis method (RAN*k*SATRA) have been described in Section 2. In Section 3 Implementation procedure for classifying the COVID-19 data set was presented. Section 4 reported model simulations and experimental setup, and section. 5 reported performance evaluation metrics Section 6 presented the result and discussion. The chapter concludes with future works presented in Final Section.

## **2. Materials and methods**

## **2.1 Random k satisfiability logic**

Propositional satisfiability logic can perceive as a logical rule that consists of clauses that contain literals or variables. Random *k* Satisfiability (RAN*k*SAT) is a class of non-systematic Boolean logic representation, consists of a random number of literals (can be the negated literals) per clause. Non-systematic Boolean Satisfiability logic (RAN*k*SAT) has been proven effective to represent simulated applications [25]. There is no study that utilizes the non-systematic behavior of Random *k* Satisfiability in discrete HNN for application real data set classification problems. The formulation of RAN*k*SAT has the following properties:


The Boolean values for each *xi* are bipolar*xi* ∈f g �1, 1 that exemplifies the notion of FALSE and TRUE respectively. The general formulation *FRAN*3*SAT* is represented in Eq. (1) as follows.

$$F\_{\text{RANkSAT}} = \wedge\_{i=0}^{t} \mathbf{C}\_{i}^{(3)} \wedge\_{i=0}^{n} \mathbf{C}\_{i}^{(2)} \wedge\_{i=0}^{m} \mathbf{C}\_{i}^{(1)} \tag{1}$$

where *t*, *n*, *m* ∈½ � 1, 2, *::k* , ∀*t*, *n*, *m* >0. The clause *FRAN*3*SAT* is defined as a random 3-SAT which consists of a clause *C*ð Þ*<sup>k</sup> <sup>i</sup>* described in Eq. (2). as follows.

$$\mathbf{C}\_{i}^{(k)} = \begin{cases} (\boldsymbol{\tau}\_{i} \lor \boldsymbol{a}\_{i} \lor \Psi\_{i}), k = \mathbf{3} \\ \quad (\boldsymbol{\tau}\_{i} \lor \boldsymbol{a}\_{i}), \ k = \mathbf{2} \\ \quad \lambda\_{i}, \quad k = \mathbf{1} \end{cases} \tag{2}$$

where *τ<sup>i</sup>* ∈ *τi*, ¬*τ<sup>i</sup>* ½ �, *α<sup>i</sup>* ∈ *αi*, ¬*α<sup>i</sup>* ½ �, Ψ*<sup>i</sup>* ∈ Ψ*i*, ¬Ψ*<sup>i</sup>* ½ �, and *λ<sup>i</sup>* ∈ *λi*, ¬*λ<sup>i</sup>* ½ � represent literals and their negation respectively. In particular, the first and second-order clauses are denoted as *C*ð Þ<sup>1</sup> *<sup>i</sup>* , *<sup>C</sup>*ð Þ<sup>2</sup> *<sup>i</sup>* , and *<sup>C</sup>*ð Þ<sup>3</sup> *<sup>i</sup>* , respectively. In this chapter, *Fr* is a Conjunctive Normal Form (CNF) formula where the clauses are chosen uniformly, independently without replacement among all 2*<sup>r</sup> <sup>m</sup>* <sup>þ</sup> *<sup>n</sup> v* � � nontrivial clauses of the length *<sup>r</sup>*. Note that, *Ai* exists in the *C*ð Þ*<sup>k</sup> <sup>i</sup>* , if the *<sup>C</sup>*ð Þ*<sup>k</sup> <sup>i</sup>* contains either *Gi* or ¬*Gi* and the mapping of *V F*ð Þ!*<sup>r</sup>* f g �1, 1 is called logical interpretation. The Boolean value for the mapping is expressed as 1 (TRUE) and � 1 (FALSE). In theory, the example of RAN*k*SAT formula for *k*≤3 is given as.

$$F\_{RAN\&SAT} = (\tau\_1 \lor \neg \tau\_2 \lor \tau\_3) \land (\neg \alpha\_1 \lor \alpha\_2) \land \neg \lambda\_1 \tag{3}$$

According to Eq. (3), *FRANkSAT* comprises of Eq. (4)–(6) as follows.

$$\mathbf{C}\_{i}^{(3)} = (\mathfrak{r}\_{1} \vee \neg \mathfrak{r}\_{2} \vee \mathfrak{r}\_{3}) \tag{4}$$

$$\mathbf{C}\_2^{(2)} = (\neg a\_1 \lor a\_2) \tag{5}$$

$$\mathbf{C}\_{\mathbf{1}}^{(1)} = \neg \mathbb{A}\_{\mathbf{1}} \tag{6}$$

Therefore, the outcome of Eq. (3) is satisfied if. Eqs. (4)–(6) are satisfied. i.e.,

$$\mathbf{C}\_i^{(3)} = \mathbf{C}\_1^{(2)} = \mathbf{C}\_2^{(1)} = \mathbf{1} \tag{7}$$

In this study, *FRANkSAT* will be embedded in the proposed model based on reverse analysis technique for COVID-19 data classification. *FRANkSAT* will cater the modified networks to unveil the true pattern or behavior of the real data sets involved. Note that *FRANkSAT* is a symbolic form representation thus it is appropriate to be integrated in these networks as HNN is a nonsymbolic platform.

*Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*

#### **2.2 Hopfield neural network (HNN)**

Hopfield type of neural network (HNN) is a recurrent neural network (RNN) that mimics the human biological brain learning structure. The architecture of HNN model consists of interconnected neurons and a powerful feature of content addressable memory that is crucial in solving various optimization and combinatorial tasks [26]. The system consists of structured *N* neurons, each of which is represented by an Ising variable. The neurons in discrete HNN are utilized in bipolar representation whereby *Si* ∈f g 1, �1 , which strictly considers values of 1 and � 1 [27]. The fundamental overview for neuron state activation in HNN is shown in Eq. (4)

$$\mathbf{S}\_{i} = \begin{cases} \mathbf{1} & \text{, if } \sum\_{j} T\_{ij} \mathbf{S}\_{j} > \alpha \\\\ -\mathbf{1} & \text{, otherwise} \end{cases} \tag{8}$$

where *Tij* is the synaptic weight from unit *j* to *i*. *Sj* is the state of neuron *j* and *ω* is the predefined threshold value. Barra et al. (2018) specified that *ω* ¼ 0 to certify the network's energy decreases. The connection in Hopfield net contains no connection with itself as follows.

$$T\_{ijk}^{(3)} = T\_{kij}^{(3)} = T\_{kji}^{(3)} \tag{9}$$

$$T\_{j\text{i}}^{(2)} = T\_{\text{ij}}^{(2)} \tag{10}$$

$$T\_i^{(1)} = T\_j^{(1)} \tag{11}$$

$$T\_{\vec{\mu}} = T\_{\vec{\mu}} = \mathbf{0} \tag{12}$$

In resulting, HNN holds symmetrical features in terms of architecture. HNN model has similar intricate details to the *Ising* model of magnetism [28]. As the neuron state is termed in bipolar *Si* ∈f g 1, �1 representation, the spin points follow in the direction of a magnetic field. This causes each neuron to flip until the equilibrium is reached. Thus, it follows the dynamics *Si* ! sgn ½ � *hi*ð Þ*t* where *hi* is the local field of the connection of the neurons. The sum of the field induced by each neuron is given as follows.

$$h\_i = \sum\_{k}^{N} \sum\_{j}^{N} T\_{ijk} \mathbb{S}\_{\vec{\beta}} \mathbb{S}\_k + \sum\_{j}^{N} T\_{\vec{\eta}} \mathbb{S}\_{\vec{\jmath}} + T\_i \tag{13}$$

The task of the local field is to evaluate the final state of neurons and generate all the possible RAN-SAT-induced logic that was obtained from the final state of neurons. One of the most prominent features of the HNN network is the fact that it always converges to stable states (Hopfield, 1982). The Lyapunov energy function (LEF) utilized in HNN for RANkSAT logic programming is presented as follows

$$H\_F = \dots - \frac{1}{3} \sum\_{i=1}^{N} \sum\_{j \neq k}^{N} \sum\_{k=1, i \neq k}^{N} T\_{ijk}^{(3)} \mathbb{S}\_i \mathbb{S}\_j \mathbb{S}\_k - \frac{1}{2} \sum\_{i=1, i \neq j}^{m} \sum\_{j=1}^{m} T\_{ij}^{(2)} \mathbb{S}\_i \mathbb{S}\_j - \sum\_{i=1, i \neq j}^{m} T\_i^{(1)} \mathbb{S}\_j \tag{14}$$

The energy function of the HNN model is especially critical since it will decide the interoperability of the network. The value obtained from the equation will be verified as global or otherwise. The network would generate the right response when the induced neuron state reached global minimum energy. There are minimal works to integrate HNN with RANkSAT as a single computational network.

## **2.3 Random k satisfiability reverse analysis (RANkSATRA)**

The central emphasis of logic mining is to extract useful logical rules from the data sets provided. One of the extraordinary fields of data mining is logic mining proposed by [22]. It was shown that the information can be expressed in logical form. As a logical rule, the reverse analysis approach (RA) was implemented to derive useful knowledge from real-life data based on the horn clause [22]. In this study, Random *k* Satisfiability enhanced reverse analysis method or abbreviated as (RAN*k*SATRA) is proposed to extract the optimum RANkSATRA logical rule to explain the behavior of the COVID-19 data sets. In this context, RANkSATRA is a logic extraction method that uses the HNN-RANkSAT model structure to extract from the data set the valuable logical rule (COVID-19 data set). Because of its non-systematic behavior, the RANkSAT logical rule would be used to describe and chart the data sets due to flexibility and convenience. In particular, the RANkSATRA approach can derive the ideal logic representing the relationship between the actual data set attributes of the COVID-19. Pursuing that, to be used in classification or estimation, the secret information in the data set is retrieved.

In our hybrid HNN model, RANkSATRA is performed out to represent a data classification framework in data mining. Inside the RANkSAT clauses, each of the attributes can be translated into atoms. To construct the RANkSAT logical rule, seven attributes from the data sets are then chosen by considering *k*≤3. Logic mining is a method that extracts information from a data set using logic programming. In this regard, this section will clarify how our HNN-RANkSATRA model implements the logic mining technique called the random 3-satisfaction-based reverse analysis process (RAN3SATRA) to obtain the relationship of COVID-19 data entries. By acquiring the synaptic weight between 3 neurons, RAN3SATRA might be able to reveal the level of their connectedness.

Consider *n* attributes of the COVID-19 data sets ð Þ *S*1, *S*2, *S*3, … , *Sn* , where *Si* ∈½ � 1, �1 . All entries are represented in bipolar states. Since this chapter considers *FRAN*3*SAT*, the arrangement of each *Sm* consists of *Si*, *Sj*, *Sk* where *i* 6¼ *j* 6¼ *k*. For *Sm* those leads *PRANkSATlearn* ¼ 1, we assign

$$\mathbf{S}\_{m} = \left( \mathbf{S}\_{i}^{\max\left[n(s\_{i})\right]} \vee \mathbf{S}\_{j}^{\max\left[n\left(s\_{j}\right)\right]} \vee \mathbf{S}\_{k}^{\max\left[n(s\_{k})\right]} \right) \tag{15}$$

$$\mathbf{S}\_{i} = \begin{cases} \mathbf{S}\_{i}, & \mathbf{S}\_{i} = \mathbf{1} \\ \neg \mathbf{S}\_{i}, & \mathbf{S}\_{i} = -\mathbf{1} \end{cases} \tag{16}$$

Based on the obtained *Sm*, we can formulate *PRANkSATbest*:

$$P\_{\text{RANkSAT}} = \bigvee\_{m=1}^{k} \mathbb{S}\_m \tag{17}$$

For example, we will choose *<sup>G</sup>*<sup>1</sup> <sup>¼</sup> ð Þ *<sup>S</sup>*<sup>1</sup> <sup>∨</sup> <sup>¬</sup>*S*<sup>2</sup> <sup>∨</sup> <sup>¬</sup>*S*<sup>3</sup> if *<sup>S</sup>* max ½ � *n S*ð Þ<sup>1</sup> <sup>1</sup> <sup>¼</sup> *<sup>S</sup>*1, *<sup>S</sup>* max ½ � *n S*ð Þ<sup>2</sup> <sup>2</sup> ¼ ¬*S*2, and *S* max ½ � *n S*ð Þ<sup>3</sup> <sup>3</sup> ¼ ¬*S*3. *PRANkSATbest* will be embedded into HNN. Henceforth, we will obtain the states of *Si* that correspond to *EFRAN*3*SATbest* ! 0. By comparing Eq. (3)

## *Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*

with Eq. (14), the corresponding *Tijk* will be obtained. During the testing phase, the induced states, *S<sup>B</sup> <sup>i</sup>* , will be obtained by obeying Eq. (13). Subsequently, the induced logic *P<sup>B</sup> <sup>i</sup>* will be constructed according to logical rule given in Eq. (2). Finally, the chosen induced logic obeys *P<sup>B</sup> <sup>i</sup>* <sup>¼</sup> *<sup>P</sup>test <sup>i</sup>* (Training data). **Figure 1** demonstrates how RANkSATRA has been implemented in the HNN model to classify COVID-19 surveillance data set (CSDS). In this study, RANkSATRA, is used to determine the relationship among the data set. In learning COVID-19 surveillance data set, {detected, not detected} would be converted into bipolar representation {1,-1}, respectively. Each objective taken would be represented in terms of neurons in RANkSATRA. Hence, there would be a total of seven neurons being considered in this data set. Each neuron will be represented with entries COVID-19 surveillance data set.

**Figure 1.** *Implementation of RAN*k*SATRA for COVID-19 surveillance data set.*

### **2.4 RANkSATRA experimental setup**

The simulation has been developed to explore the capacity of the Random kSatisfiability reverse analysis (RANkSATRA) in Hopfield neural network for COVID-19 surveillance data set classification. Sixty percent (60%) of the data points in the databases were used for learning data collected, and four ty percent (40%) were used for testing. Microsoft Visual C++ applications running on Windows 8.1, 64-bit, 4.40 GHz CPU, 4GB RAM, and 400 GB hard drive specifications were adopted. For both learning and testing, the overall CPU time is 24 hr. If the model crosses the recommended processor time threshold, the recommended algorithm structure cannot train HNN-based RANkSATRA using real life. In terms of the logical rule that will be embedded inside HNN, the existing work of Sathasivam and Abdullah [29] that implemented HORNSAT in their proposed reverse analysis method. RANMAXkSAT has been proposed [30] and RANkSAT has been proposed in [31]. Both of these proposed models were considered the only existing logic mining in the literature.

#### **2.5 Implementation of COVID-19 surveillance data set**

In this chapter, COVID-19 surveillance data set was occupied in RAN*k*SATRA, HORN*k*SATRA, and RANMAX*k*SATRA for classification COVID-19 data set collected from UCI machine learning repository. It contains information about the data set and contains different purposes. The original data contains 7 instances with nine attributes with two classes. The classes are detected and not detected. But, to find out more relevant features from a COVID-19 data set, feature selection methods are applied to the data set. In this experiment, our aim is to that utilize the same data set. The details of COVID-19 are shown in **Table 1**.

## **3. Performance evaluation metrics**

In this section, simulation experiments were performed to assess the performance of the proposed logical rule model on a different number of clauses. The performance evaluation indicators are deployed to analyze the effectiveness of our SATRA model in extracting important logical rule for CSDS. The metrics used in this study measure the performance of the training phase of HNN models. The metric solely indicates the performance of the retrieved neuron state that contributes to the best CSDS classification. During the learning phase, the performance of the RAN*k*SAT representation that governs the network will be evaluated based on the following fitness equation:

$$f\_k = \sum\_{k=1}^{\text{NC}} \mathbf{C}\_k \tag{18}$$

NC is the number of clauses for any given *P<sup>B</sup> <sup>k</sup>* . According to Eq. (18) *Ck* is defined as follows.

$$\mathbf{C}\_{k} = \begin{cases} \mathbf{1} & \text{True} \\ \mathbf{0} & \text{False} \end{cases} \tag{19}$$

*Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*


**Table 1.**

*List of attributes for COVID-19 surveillance data set (CSDS) [32].*

The measurements are evaluated based on the accuracy, and errors accumulation that reflects the network complexity based on the number of neurons using the following formula.

$$\text{TRANING\\_MAE} = \sum\_{i=1}^{n} \frac{1}{n} |f\_{\text{max}} - f\_k| \tag{20}$$

$$\text{TRAINMING\\_RMSE} = \sum\_{i=1}^{n} \sqrt{\frac{1}{n} \left(f\_{\text{max}} - f\_k\right)^2} \tag{21}$$

where *f* max and *f <sup>k</sup>* are the output value and target output value, respectively, and *n* is a number of the iterations.

$$\text{TRAINING\\_BIC} = nIn(\text{MSE}) + pa.In(n) \tag{22}$$

where *n*, *pa*, and *MSE* indicate the number of solutions obtained, their parameters, and the mean square error used in the model, respectively. Since the HNN is free from any pa [33], the equation is re-written as follows.

$$\text{TRAINING\\_BIC} = n \ln(\text{MSE}) \tag{23}$$

where the *MSE* is measured in calculating *BIC* and *n* depicts the number of iterations during the simulation. Hence, the formula of MSE is given as follows,

$$\text{CTRAINING\\_MSE} = \frac{1}{n} \sum\_{i=1}^{n} \left( f\_{\text{max}} - f\_k \right)^2 \tag{24}$$


**Table 2.**

*Training error and accuracy for all HNN models.*

where *fi* and *f* max describe the fitness value observed during each of the execution and the maximum fitness, respectively.

$$\text{TRAINMING\\_ACCURACY} = \frac{P\_{induced}^{Correct}}{N\_{P\_{tot}}} \times 100\% \tag{25}$$

The performance of the HNN on the proposed logical rule is presented in **Table 2**.

## **4. Result and discussion**

The performance of the simulated program with different complexities for neurons in the HNN-RAN*k*SATRA model will be evaluated with the existing models HNN-HORNSAT [29] and RANMAX*k*SAT [34] in terms of root mean square error (RMSE), mean absolute error (MAE), Bayesian information criterion (BIC), accuracy, and CPU time. **Figures 2** and **3** illustrate the root mean square error (RMSE) and mean absolute error (MAE) of HNN models during the training process. This analysis only considers 1≤ *NC*≤ 10. The COVID-19 surveillance data set (CSDS) data have successfully been embedded into the network and forming variants of learnable Boolean k Satsifiability logic, RANkSAT with the existing HORNSAT and RANMAX*k*SAT. A comparison has been made between the variants of satisfiability logic for COVID-19 surveillance data set (CSDS) data classification. As seen in

**Figure 2.** *MAE evaluation of HNN models for COVID-19 classification.*

*Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*

**Figure 2**, HNN-RAN*k*SATRA with NC = 1 until NC = 10 has the best performance in terms of RMSE compared to HNN-HORN*k*SATRA and RANMAX*k*SATRA. This is because the HNN-RAN*k*SAT utilizes random logical inconsistencies to derive the optimum synaptic weight for HNN. Optimal synaptic weight is a building block for optimum CSDS classification. The RMSE result from **Figure 2** has been supported by the value of MAE in **Figure 3**.

The investigation of a model's performance is separated into two parts. The first significant part is to examine the quality of the solution generated by different searching techniques by employing suitable training errors. Secondly is to analyze the robustness and efficiency of the proposed model by comparing *CT* and *Q* needed to execute the models' mechanism. There are five performance evaluation metrics involved to analyze the training and testing stage of our modified models as presented in the performance evaluation section. Therefore, this research's main contribution is to portray the competency of HNN in SAT in outperforming the existing models.

In **Figure 2**, HNN-RAN*k*SATRA with NC = 2 has the best performance in terms of MAE. It can be observed that MAE for NC = 2 is equal to 0.027 compared with NC = 10 which recorded 1.3515. The searching process of HNN for HORN*k*STRA and RANMAXkSTRA displayed a similar error trend with RANMAXkSTRA has the highest error at NC = 8. In **Figure 3**, HNN-RAN*k*SATRA has the best performance in terms of RMSE. It can be observed at NC = 1, the RMSE is equal to 0.0323 and 1.3995 was recorded at NC = 10, which are lower than HNN-HORNSAT and HNN-RANMAX*k*STRA. The HNN-RANMAX*k*STRA recorded the highest RMSE with 0.832 at NC = 1 and 10.4602 at NC = 10. The searching process of HNN for RAN*k*STRA and HORN*k*SATRA displayed a similar RMSE trend with closed merging. As the number of neurons increased, the learning phase of HNN models was convoluted because the network required to find the consistent interpretation for the best logic for optimal COVID-19 surveillance data set (CSDS) classification. In this case, the learning phase of HNN for both RANMAX*k*STRA and Horn*k*SATRA was trapped in the trial and error search process, which resulted in high RMSE and MAE accumulations. However, the RMSE and MAE recorded by HNN-HORNSAT and RANMAX*k*STRA were to some extent higher than the RAN*k*STRA. At *NC* = 5, the value of MAE and RMSE are approximately 57% times bigger than *NC* = 10 because for the network to converge into

**Figure 3.** *RMSE evaluation of HNN models for COVID-19 classification.*

**Figure 4.** *BIC evaluation of HNN models for COVID-19 classification.*

full fitness (learning completed), more iterations are needed. Therefore, a similar trend can be seen in the HNN model as the complexity increases. Thus, HNN model works optimally in learning the variants of satisfiability logic entrenched to the network before being stored into content addressable memory. The complete learning process will ensure the network generates the best logic to represent the characteristic of the HNN for optimal COVID-19 surveillance data set (CSDS) classification.

In contrast, the learning phase in HNN-HORNSAT and HNN- RANMAX*k*STRA were computationally expensive as more iterations were needed leading to higher RMSE and MAE values compared to HNN-RAN*k*SATRA. All in all, SATRA contributes to generating the best logic to represent the relationship between each instance and the verdict of HNN for COVID-19 surveillance data set (CSDS) classification. The MAE and RMSE results displayed in **Figures 2** and **3** were supported by BIC in **Figure 4**. The "best" model will be the one that neither under-fits nor over-fits. Although the BIC will choose the best model from a set of models, it will not say anything about the absolute quality of the model. However, the HNN-RAN*k*SATRA is the best choice for COVID-19 surveillance data set (CSDS) classification. In terms of BIC, HNN-RAN*k*SATRA outclasses other models. The accumulation of MSE tends to penalize the values of BIC. The *BIC* for HNN-RAN*k*SATRA is, therefore, the lowest compared to the other two models.

**Table 3** displays the CPU Time results for the HNN models, respectively. To assess the robustness of the models in logic mining, CPU time is recorded for the learning and retrieval phase of HNN. HNN less CPU time is required to complete one execution of learning and testing for CSDS classification when the number of NC deployed is less. As it stands, HNN-RAN*k*SATRA model, when the complexity is higher, models take a long time to finish the learning process. Overall, the HNN continues to be proficient at reducing the k Satisfiability inconsistencies and computing the global solution in a reasonable amount of time on the CPU. Because there are more instances to handle during the learning and testing phase of HNN, the CPU Time for HNN-RANMAXkSAT is consistently greater than HNN-RANkSATRA and HNN-HORNSATRA. However, the CPU time recorded for the existing methods was higher due to more iterations needed in generating the best logic for the HNN.

*Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*


#### **Table 3.**

*Computation (CPU) time(s) for the HNN model.*

**Table 2** displays the testing error and accuracy data collected for each model when the HNN was tested. As a result, for each of NC = 1 through NC = 8, the testing RMSE, MAE, and accuracy recorded for HNN-RANkSATRA, HNN-RANMAXkSAT, and HNN-HORNSAT were consistently identical. The ability of our suggested network, SATRA and HNN-kSAT, to produce the optimal logic during the learning phase, which contributes to a very low error, is thus demonstrated by this. According to performance evaluation metrics captured during simulation, the learning mechanism in SATRA is capable of deriving the best logic to map the relationships between the characteristics in HNN. 96.30 percent accuracy was attained by the suggested model, as measured by the accuracy that each model recorded. The existing works on logic mining in HNN can still achieve up to 80% of the CSDS classification accuracy. To sum up, HNN-RAN*k*SATRA is the best model for learning and testing HNN due to lower values of RMSE, MAE, and the highest accuracy for a logical rule. Hence, the logical rule obtained from HNN-RAN*k*SATRA will benefit the healthcare sector in the CSDS classification problem.

## **5. Conclusion**

In this research, the formulation of constructing HNN proved to be adequate to represent the mechanism in RAN*k*SAT the implementation of EA with standalone HNN framework with reverse analysis proved to be effective in solving real-life data sets. In order to optimally express the relationship in a data set, we successfully turned the COVID-19 data set into an ideal logical representation in the form of RANkSAT representation in this chapter. Furthermore, we used COVID-19-RANkSATRA as a substitute method for identifying correlations between the variables that correspond to classification between *FRANkSAT* ¼ 1 (Detected) and *FRANkSAT* ¼ �1 (not detected) of the COVID-19 data set. To work, the neural network needed to be trained. Because the structure of a neural network (NN) differs from the structure of microprocessors, it must be imitated. For large neural networks, it required a lot of processing time and space in weight training and adjustment, system adaptation for determining the number of layers, node transfer functions, retrieval phase, and learning rules.

One of the limitations of Hopfield type of artificial neural network is that it sometimes gets trapped at the local solution (premature convergence) instead of the global one. Our Future direction is to incorporate novel metaheuristics algorithms such as Election algorithm, genetics algorithm, dragonfly algorithm, etc. to enhance the performance of Hopfield type of artificial network for better training and retrieval process in preventing the Hopfield type of artificial network in settling in the local solution for better searching and classification problems. We will further utilize other variants of Boolean satisfiability such as k-SAT, Rondom Half-SAT, MAX-kSAT, Random NAE-SAT, and XOR-SAT for better optimization problems. Various type of data set, such as agriculture, financial, actuarial as well as environmental data set will also be used in our future studies.

## **Author details**

Hamza Abubakar1,2\* and Muntari Idris2

1 University of Science, School of Mathematical Sciences, Malaysia

2 Department of Mathematics, Isa Kaita College of Education, Dutsin-ma, Katsina State, Nigeria

\*Address all correspondence to: zeeham4u2c@ikcoe.edu.ng

© 2022 The Author(s). Licensee IntechOpen. This chapter is distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

*Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*

## **References**

[1] Roberts M, Driggs D, Thorpe M, Gilbey J, Yeung M, Ursprung S, et al. Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scans. Nature Machine Intelligence. 2021:**3**(3);199-217

[2] Chiroma H, Ezugwu AE, Jauro F, Al-Garadi MA, Abdullahi IN, Shuib L. Early survey with bibliometric analysis on machine learning approaches in controlling COVID-19 outbreaks. PeerJournal of Computer Science. 2020; **6**:e313

[3] Elaziz MA, Hosny KM, Salah A, Darwish MM, Lu S, Sahlol AT. New machine learning method for imagebased diagnosis of COVID-19. PLoS One. 2020;**15**(6):e0235187

[4] Manap HH, Md Tahir N, Yassin AIM. Statistical analysis of Parkinson disease gait classification using artificial neural network. IEEE International Symposium on Signal Processing and Information Technology ISSPIT 2011. 2011. pp. 060-065

[5] Grover S, Bhartia S, Akshama YA, Seeja KR. Predicting severity of Parkinson's disease using deep learning. Procedia Computer Science. 2018;**132**: 1788-1794

[6] Ström F, Koker R. A parallel neural network approach to prediction of Parkinson's disease. Expert Systems with Applications. 2011;**38**(10): 12470-12474

[7] Bind S, Tiwari AK, Sahani AK. A survey of machine learning based approaches for Parkinson disease prediction. International Journal of Computer Science Information Technology. 2015;**6**(2):1648-1655

[8] Saritas I. Prediction of breast cancer using artificial neural networks. Journal of Medical Systems. 2012;**36**(5):2901-2907

[9] Karayilan T, Kiliç Ö. Prediction of heart disease using neural network. In: 2017 International Conference on Computer Science Engineering (UBMK). 2017. pp. 719-723

[10] Pan S, Warwick K, Stein J, Gasson MN, Wang SY, Aziz TZ, et al. Prediction of Parkinson's disease tremor onset using artificial neural networks. Proceedings of the fifth IASTED International Conference: biomedical engineering 2007. pp. 341-345

[11] Wu D, Warwick K, Ma Z, Gasson MN, Burgess JG, Pan S, et al. Prediction of parkinson's disease tremor onset using a radial basis function neural network based on particle swarm optimization. International Journal of Neural Systems. 2010:**37**(4);2923-2928

[12] Vijayarani S, Dhayanand S, Professor A. Research scholar MP. Kidney disease prediction using SVM and ANN algorithms. International Journal of Computing and Business Research ISSN (Online). 2015;**6**(2):1-12

[13] Kasikumar K, Mohamed Najumuddeen M, Suresh R. Applications of data mining techniques in healthcare and prediction of heart attacks. International Journal of Data Minimum Technology Application. 2018;**2**(02): 250-255

[14] Tang J, Yang B, Adams MP, Shenkov NN, Klyuzhin IS, Fotouhi S, et al. Artificial neural network–based prediction of outcome in Parkinson's disease patients using DaTscan SPECT imaging features. Molecular Imaging and Biology. 2019;**21**(6):1165-1173

[15] Ibrahim F, Taib MN, Abas WABW, Guan CC, Sulaiman S. A novel dengue fever (DF) and dengue haemorrhagic fever (DHF) analysis using artificial neural network (ANN). Computer Methods and Programs in Biomedicine. 2005;**79**(3):273-281

[16] Ardi Handojoseno AM, Shine JM, Nguyen TN, Tran Y, Lewis SJG, Nguyen HT. Analysis and prediction of the freezing of gait using EEG brain dynamics. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2015;**23**(5):887-896

[17] Wang X, Zhang M, Zhu J, Geng S. Spectral prediction of Phytophthora infestans infection on tomatoes using artificial neural network (ANN). International Journal of Remote Sensing. 2008;**29**(6):1693-1706

[18] Shantakumar BP, Kumaraswamy YS. Intelligent and effective heart attack prediction system using data mining and artificial neural network. European Journal of Scientific Research. 2009;**31** (4):642-656

[19] Khan MM, Mendes A, Chalup SK. Evolutionary wavelet neural network ensembles for breast cancer and Parkinson's disease prediction. PLoS One. 2018;**13**(2):e0192192

[20] Rau HH, Hsu CY, Lin YA, Atique S, Fuad A, Wei LM, et al. Development of a web-based liver cancer prediction model for type II diabetes patients by using an artificial neural network. Computer Methods and Programs in Biomedicine. 2016;**119**(1):29-42

[21] Janghel RR, Shukla A, Tiwari R, Kala R. Breast cancer diagnosis using artificial neural network models. The 3rd International Conference on Information Sciences and Interaction Sciences ICIS. 2010. pp. 89-94

[22] Sathasivam S, Wan Abdullah WAT. Logic mining in neural network: Reverse analysis method. Computing (Vienna/ New York). 2011;**91**(2):119-133

[23] Alzaeemi SAS, Sathasivam S. Examining the forecasting movement of palm oil Price using RBFNN-2SATRA metaheuristic algorithms for logic mining. IEEE Access. 2021;**9**:22542-22557

[24] Alzaeemi SA, Sathasivam S. Artificial immune system in doing 2 satisfiability based reverse analysis method via a radial basis function neural network. PRO. 2020;**8**(10):1295

[25] Sathasivam S, Mansor MA, Kasihmuddin MSM, Abubakar H. Election algorithm for random k satisfiability in the Hopfield neural network. PRO. 2020;**8**(5):568

[26] Uykan Z. On the working principle of the Hopfield neural networks and its equivalence to the GADIA in optimization. IEEE Transactions on Neural Networks and Learning Systems. 2020;**31**(9):3294-3304

[27] Sathasivam S. Enhancing logic programming performance in recurrent Hopfield network. European Journal of Scientific Research. 2009;**37**(1):1-7

[28] Bukov M, Day AGR, Sels D, Weinberg P, Polkovnikov A, Mehta P. Reinforcement learning in different phases of quantum control. Physical Review X. 2018;**8**(3):031086

[29] Sathasivam S, Abdullah WAT. Logic mining in neural network: Reverse analysis method. Computing. 2011;**91** (2):119-133

[30] Abubakar H. Neuro-symbolic integration of Hopfied neural network for optimal maximum random kSatisfiability (MAXRkSAT)

*Artificial Neural Network Logic-Based Reverse Analysis with Application to COVID-19… DOI: http://dx.doi.org/10.5772/intechopen.106210*

representation. Journal of Reliability and Statistical Studies. 2020:199-220

[31] Abubakar H, Sathasivam S. Developing random satisfiability logic programming in Hopfield neural network. AIP Conference Proceedings. 2020;**2266**(1):040001

[32] Kemenkes RI. Pedoman Pencegahan dan Pengendalian Coronavirus Disease (COVID-19). Germas. 2020;1(2):136-151

[33] Hamadneh N, Sathasivam S, Tilahun SL, Choon OH. Learning logic programming in radial basis function network via genetic algorithm. Journal of Applied Sciences. 2012;**12**(9):840-847

[34] Abubakar H, Abdu Masanawa S, Yusuf S. Neuro-symbolic integration of Hopfield neural network for optimal maximum random kSatisfiability (Maxrksat) representation. Journal of Reliability and Statistical Studies. 2020; **49**(2)

## **Chapter 4**
