Skip to main content
SpringerLink
Log in

J-type random 2,3 satisfiability: a higher-order logical rule in discrete hopfield neural network

  • Research Paper
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

The Discrete Hopfield Neural Network has been widely used for solving combinatorial optimization problems. DHNN is a simple structure with no hidden layer and binary input/output which leads to lower complexity compared to other networks. Satisfiability as a neuron representation is considered a suitable logical structure due to its simple construction. DHNN model has the potential for enhancement by incorporating various logical rules. The main problem of existing work is the need for higher-order logical rules combined with systematic, non-systematic logic. This paper proposed a novel satisfiability logical structure named J-Type Random 2,3 Satisfiability by considering both the characteristics of the second and third-order variable per clause. The proposed logical rule randomly assigns values based on the structure of either second-order, third-order, or both orders of the clause. The proposed J Random 2,3 Satisfiability logical rule will store the information externally and only be true if all the clauses are satisfiable. This logic will be implemented into the Discrete Hopfield Neural Network. By utilizing the proposed hybrid logical rule, specifically the J Random 2,3 Satisfiability, the neuron in the Hopfield Neural Network can be effectively modeled. The model will be evaluated using various performance metrics in terms of learning error, retrieval error, energy analysis, and similarity analysis. The proposed logic will undergo a comparison analysis with previously established logical rules. Based on the ratio of global solutions, the proposed model exhibited a slower decline from 1 to 0 as the number of neurons increased which suggests that the proposed model will outperform existing models in retrieving global neuron state.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Algorithm 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

No data was used for the research described in the article.

References

  1. McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5:115–133

    Article  MathSciNet  Google Scholar 

  2. Rosenblatt F (1958) The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 65(6):386

    Article  Google Scholar 

  3. Zeng N, Li X, Wu P, Li H, Luo X (2024) A novel tensor decomposition-based efficient detector for low-altitude aerial objects with knowledge distillation scheme. IEEE/CAA J Autom Sin 11(2):487–501

    Article  Google Scholar 

  4. Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. Adv Neural Inf Process Syst 26:3111–3119

    Google Scholar 

  5. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115–118

    Article  Google Scholar 

  6. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  7. Zeng N, Wu P, Zhang Y, Li H, Mao J, Wang Z (2024) DPMSN: A Dual-Pathway Multiscale Network for Image Forgery Detection. IEEE Trans Ind Inform

  8. Wu P, Wang Z, Li H, Zeng N (2024) KD-PAR: A knowledge distillation-based pedestrian attribute recognition model with multi-label mixed feature learning network. Expert Syst Appl 237:121305

    Article  Google Scholar 

  9. Hopfield JJ, Tank DW (1985) “Neural” computation of decisions in optimization problems. Biol Cybern 52(3):141–152

    Article  Google Scholar 

  10. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79(8):2554–2558

    Article  MathSciNet  Google Scholar 

  11. Tank D, Hopfield J (1986) Simple’neural’optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit. IEEE Trans Circ Syst 33(5):533–541

    Article  Google Scholar 

  12. Aloul FA, Sakallah KA, Markov IL (2006) Efficient symmetry breaking for boolean satisfiability. IEEE Trans Comput 55(5):549–558

    Article  Google Scholar 

  13. Abdullah WATW (1992) Logic programming on a neural network. Int J Intell Syst 7(6):513–519

    Article  Google Scholar 

  14. Sathasivam S (2010) Upgrading logic programming in Hopfield network. Sains Malaysiana 39(1):115–118

    Google Scholar 

  15. Kasihmuddin MSM, Mansor MA, Md Basir MF, Sathasivam S (2019) Discrete mutation Hopfield neural network in propositional satisfiability. Mathematics 7(11):1133

    Article  Google Scholar 

  16. Mansor MA, Kasihmuddin MSM, Sathasivam S (2017) Artificial Immune System Paradigm in the Hopfield Network for 3-Satisfiability Problem. Pertanika J Sci Technol 25(4):1173–1188

    Google Scholar 

  17. Sathasivam S, Mansor MA, Ismail AIM, Jamaludin SZM, Kasihmuddin MSM, Mamat M (2020) Novel random k satisfiability for k≤ 2 in hopfield neural network. Sains Malays 49(11):2847–2857

    Article  Google Scholar 

  18. Karim SA, Zamri NE, Alway A, Kasihmuddin MSM, Ismail AIM, Mansor MA, Hassan NFA (2021) Random satisfiability: A higher-order logical approach in discrete Hopfield Neural Network. IEEE Access 9:50831–50845

    Article  Google Scholar 

  19. Alway A, Zamri NE, Karim SA, Mansor MA, Mohd Kasihmuddin MS, Mohammed Bazuhair M (2022) Major 2 satisfiability logic in discrete Hopfield neural network. Int J Comput Math 99(5):924–948

    Article  MathSciNet  Google Scholar 

  20. Gao Y, Guo Y, Romli NA, Kasihmuddin MSM, Chen W, Mansor MA, Chen J (2022) GRAN3SAT: Creating flexible higher-order logic satisfiability in the discrete hopfield neural network. Mathematics 10(11):1899

    Article  Google Scholar 

  21. Zamri NE, Azhar SA, Mansor MA, Alway A, Kasihmuddin MSM (2022) Weighted random k satisfiability for k= 1, 2 (r2SAT) in discrete Hopfield neural network. Appl Soft Comput 126:109312

    Article  Google Scholar 

  22. Guo Y, Kasihmuddin MSM, Gao Y, Mansor MA, Wahab HA, Zamri NE, Chen J (2022) YRAN2SAT: A novel flexible random satisfiability logical rule in discrete hopfield neural network. Adv Eng Softw 171:103169

    Article  Google Scholar 

  23. Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82

    Article  Google Scholar 

  24. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323(6088):533–536

    Article  Google Scholar 

  25. Bruck J, Goodman JW (1988) A generalized convergence theorem for neural networks. IEEE Trans Inf Theory 34(5):1089–1092

    Article  MathSciNet  Google Scholar 

  26. Abdullah WATW (1994) Seeking global minima. J Comput Phys 110(2):320–326

    Article  MathSciNet  Google Scholar 

  27. Mansor MA, Sathasivam S (2016) Accelerating activation function for 3-satisfiability logic programming. Int J Intell Syst Appl 8(10):44

    Google Scholar 

  28. Zamri NE, Alway A, Mansor A, Mohd Kasihmuddin MS, Sathasivam S (2020) Modified Imperialistic Competitive Algorithm in Hopfield Neural Network for Boolean Three Satisfiability Logic Mining. Pertanika J Sci Technol 28(3):983–1008

    Google Scholar 

  29. Ismail M, Sale M, Yu Y, Pillai N, Liu S, Pflug B, Bies R (2021) Development of a genetic algorithm and NONMEM workbench for automating and improving population pharmacokinetic/pharmacodynamic model selection. J Pharmacokinet Pharmacodyn 49:243–256

    Article  Google Scholar 

  30. Norouzi M, Fleet DJ, Salakhutdinov RR (2012) Hamming distance metric learning. Adv Neural Inf Process Syst 25:1704–1716

    Google Scholar 

  31. Sondur MSD, Chigadani MAP, Nayak S (2016) Similarity measures for recommender systems: a comparative study. J Res 2(3):76–80

    Google Scholar 

  32. Mansor MA, Sathasivam S (2021) Optimal performance evaluation metrics for satisfiability logic representation in discrete hopfield neural network. Int J Math Comput Sci 16(3):963–976

    MathSciNet  Google Scholar 

  33. Loo LH, Lin HJ, Steininger RJ III, Wang Y, Wu LF, Altschuler SJ (2009) An approach for extensibly profiling the molecular states of cellular subpopulations. Nat Methods 6(10):759–765

    Article  Google Scholar 

  34. Kasihmuddin MSBM, Mansor MAB, Sathasivam S (2016) Genetic algorithm for restricted maximum k-satisfiability in the Hopfield network. Int J Interact Multimedia Artif Intell 4:52–60

    Google Scholar 

  35. Chen J, Kasihmuddin MSM, Gao Y, Guo Y, Mansor MA, Romli NA., ... Zheng C (2023) PRO2SAT: Systematic Probabilistic Satisfiability logic in Discrete Hopfield Neural Network. Adv Eng Softw 175:103355

  36. Lee CC, de Gyvez JP (1996) Color image processing in a cellular neural-network environment. IEEE Trans Neural Netw 7(5):1086–1098

    Article  Google Scholar 

  37. Schawe H, Bleim R, Hartmann AK (2019) Phase transitions of the typical algorithmic complexity of the random satisfiability problem studied with linear programming. PLoS ONE 14(4):e0215309

    Article  Google Scholar 

  38. Zimmerman DW, Zumbo BD (1993) Relative power of the Wilcoxon test, the Friedman test, and repeated-measures ANOVA on ranks. The Journal of Experimental Education 62(1):75–86

    Article  Google Scholar 

  39. Emami H, Derakhshan F (2015) Election algorithm: A new socio-politically inspired strategy. AI Commun 28(3):591–603

    Article  MathSciNet  Google Scholar 

  40. Tran-Ngoc H, Khatir S, De Roeck G, Bui-Tien T, Nguyen-Ngoc L, Abdel Wahab M (2018) Model updating for Nam O bridge using particle swarm optimization algorithm and genetic algorithm. Sensors 18(12):4131

    Article  Google Scholar 

  41. Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39:459–471

    Article  MathSciNet  Google Scholar 

  42. Zamri NE, Mansor MA, Kasihmuddin MSM, Sidik SS, Alway A, Romli NA., ... Jamaludin SZM (2024) A modified reverse-based analysis logic mining model with Weighted Random 2 Satisfiability logic in Discrete Hopfield Neural Network and multi-objective training of Modified Niched Genetic Algorithm. Expert Syst Appl 240:122307

  43. Manoharam G, Kasihmuddin MSM, Antony SNFMA, Romli NA, Rusdi NA, Abdeen S, Mansor MA (2023) Log-Linear-Based Logic Mining with Multi-Discrete Hopfield Neural Network. Mathematics 11(9):2121

    Article  Google Scholar 

  44. Jamaludin SZM, Romli NA, Kasihmuddin MSM, Baharum A, Mansor MA, Marsani MF (2022) Novel logic mining incorporating log linear approach. J King Saud Univ-Comput Inf Sci 34(10):9011–9027

    Google Scholar 

  45. Kho LC, Kasihmuddin MSM, Mansor M, Sathasivam S (2020) Logic Mining in League of Legends. Pertanika J Sci Technol 28(1):211–225

    Google Scholar 

Download references

Funding

This research was supported by Ministry of Higher Education Malaysia for Transdisciplinary Research Grant Scheme (TRGS) with Project Code: TRGS/1/2020/USM/02/3/2.

Author information

Authors and Affiliations

  1. School of Mathematical Sciences, Universiti Sains Malaysia, 11800, Penang, Malaysia

    Xiaofeng Jiang, Mohd Shareduwan Mohd Kasihmuddin, Yueling Guo, Yuan Gao, Nur Ezlin Zamri & Muhammad Fadhil Marsani

  2. School of Science, Hunan Institute of Technology, Hengyang, 421002, China

    Yueling Guo

  3. School of Medical Information Engineering, Chengdu University of Traditional Chinese Medicine, Chengdu, 610000, China

    Yuan Gao

  4. School of Distance Education, Universiti Sains Malaysia, 11800, Penang, Malaysia

    Mohd. Asyraf Mansor

Authors
  1. Xiaofeng Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohd Shareduwan Mohd Kasihmuddin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yueling Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuan Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mohd. Asyraf Mansor
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nur Ezlin Zamri
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Muhammad Fadhil Marsani
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

X.J. did Conceptualization and methodology; Yl.G. did validation; M.S.M.K. did writing—review and editing; Y.G.did investigation; X.J. did writing—original draft preparation; N.E.Z. prepared visualization and software; M.A. M did supervision and funding acquisition; M.F.M. did visualization. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Mohd Shareduwan Mohd Kasihmuddin.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, X., Kasihmuddin, M.S.M., Guo, Y. et al. J-type random 2,3 satisfiability: a higher-order logical rule in discrete hopfield neural network. Evol. Intel. (2024). https://doi.org/10.1007/s12065-024-00936-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12065-024-00936-5

Keywords

Search

Navigation