Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
157 tokens/sec
GPT-4o
43 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Numerical Association Rule Mining: A Systematic Literature Review (2307.00662v1)

Published 2 Jul 2023 in cs.LG and cs.DB

Abstract: Numerical association rule mining is a widely used variant of the association rule mining technique, and it has been extensively used in discovering patterns and relationships in numerical data. Initially, researchers and scientists integrated numerical attributes in association rule mining using various discretization approaches; however, over time, a plethora of alternative methods have emerged in this field. Unfortunately, the increase of alternative methods has resulted into a significant knowledge gap in understanding diverse techniques employed in numerical association rule mining -- this paper attempts to bridge this knowledge gap by conducting a comprehensive systematic literature review. We provide an in-depth study of diverse methods, algorithms, metrics, and datasets derived from 1,140 scholarly articles published from the inception of numerical association rule mining in the year 1996 to 2022. In compliance with the inclusion, exclusion, and quality evaluation criteria, 68 papers were chosen to be extensively evaluated. To the best of our knowledge, this systematic literature review is the first of its kind to provide an exhaustive analysis of the current literature and previous surveys on numerical association rule mining. The paper discusses important research issues, the current status, and future possibilities of numerical association rule mining. On the basis of this systematic review, the article also presents a novel discretization measure that contributes by providing a partitioning of numerical data that meets well human perception of partitions.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (114)
  1. Dhrubajit Adhikary and Swarup Roy. 2015a. Mining quantitative association rules in real-world databases: A review. In 2015 1st International Conference on Computing and Communication Systems (I3CS), Vol. 1. IGI Global, India, 87–92.
  2. Dhrubajit Adhikary and Swarup Roy. 2015b. Trends in quantitative association rule mining techniques. In 2015 IEEE 2nd International Conference on Recent Trends in Information Systems (ReTIS). IEEE, India, 126–131.
  3. Wolf search algorithm for numeric association rule mining. In 2016 IEEE International Conference on Cloud Computing and Big Data Analysis (ICCCBDA). IEEE, China, 146–151. https://doi.org/10.1109/ICCCBDA.2016.7529549
  4. Mining Association Rules Between Sets of Items in Large Databases. ACM SIGMOD Record 22, 2 (1993), 207–216. https://doi.org/10.1145/170036.170072
  5. Rakesh Agrawal and Ramakrishnan Srikant. 1994. Fast Algorithms for Mining Association Rules in Large Databases. In Proceedings of VLDB’1994 – the 20th International Conference on Very Large Data Bases. Morgan Kaufmann, Chile, 487–499.
  6. Bilal Alataş and Erhan Akin. 2006. An efficient genetic algorithm for automated mining of both positive and negative quantitative association rules. Soft Computing 10, 3 (2006), 230–237.
  7. Bilal Alatas and Erhan Akin. 2008. Rough particle swarm optimization and its applications in data mining. Soft Computing 12, 12 (2008), 1205–1218.
  8. Bilal Alatas and Erhan Akin. 2009. Chaotically encoded particle swarm optimization algorithm and its applications. Chaos, Solitons & Fractals 41, 2 (2009), 939–950. https://doi.org/10.1016/j.chaos.2008.04.024
  9. MODENAR: Multi-objective differential evolution algorithm for mining numeric association rules. Applied Soft Computing 8, 1 (2008), 646–656. https://doi.org/10.1016/j.asoc.2007.05.003
  10. Mehrdad Almasi and Mohammad Saniee Abadeh. 2015. Rare-PEARs: A new multi objective evolutionary algorithm to mine rare and non-redundant quantitative association rules. Knowledge-Based Systems 89 (2015), 366–384. https://doi.org/10.1016/j.knosys.2015.07.016
  11. Elif Varol Altay and Bilal Alatas. 2020. Intelligent optimization algorithms for the problem of mining numerical association rules. Physica A: Statistical Mechanics and its Applications 540 (2020), 123142.
  12. Elif Varol Altay and Bilal Alatas. 2021. Differential evolution and sine cosine algorithm based novel hybrid multi-objective approaches for numerical association rule mining. Information Sciences 554 (2021), 198–221. https://doi.org/10.1016/j.ins.2020.12.055
  13. Elif Varol Altay and Bilal Alatas. 2022. Chaos numbers based a new representation scheme for evolutionary computation: Applications in evolutionary association rule mining. Concurrency and Computation: Practice and Experience 34, 5 (2022), e6744.
  14. Victoria Pachón Álvarez and Jacinto Mata Vázquez. 2012. An evolutionary algorithm to discover quantitative association rules from huge databases without the need for an a priori discretization. Expert Systems with Applications 39, 1 (2012), 585–593.
  15. Alireza Askarzadeh. 2016. A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm. Computers & Structures 169 (2016), 1–12. https://doi.org/10.1016/j.compstruc.2016.03.001
  16. A comprehensive review of visualization methods for association rule mining: Taxonomy, Challenges, Open problems and Future ideas. arXiv:cs.DB/2302.12594
  17. Yonatan Aumann and Yehuda Lindell. 2003. A statistical theory for quantitative association rules. Journal of Intelligent Information Systems 20, 3 (2003), 255–283.
  18. Kitchenham BA and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. 2 (01 2007).
  19. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion 58 (2020), 82–115. https://doi.org/10.1016/j.inffus.2019.12.012
  20. Multi-objective PSO algorithm for mining numerical association rules without a priori discretization. Expert systems with applications 41, 9 (2014), 4259–4273.
  21. Swarm intelligence: from natural to artificial systems. Number 1. Oxford university press.
  22. Mining optimized gain rules for numeric attributes. In Proceedings of KDD’99 – the 5th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, New York, 135–144.
  23. Oliver Büchter and Rüdiger Wirth. 1998. Discovery of association rules over ordinal data: A new and faster algorithm and its application to basket analysis. In Research and Development in Knowledge Discovery and Data Mining, Xindong Wu, Ramamohanarao Kotagiri, and Kevin B. Korb (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 36–47.
  24. Umit Can and Bilal Alatas. 2017. Automatic mining of quantitative association rules with gravitational search algorithm. International Journal of Software Engineering and Knowledge Engineering 27, 03 (2017), 343–372.
  25. Keith CC Chan and Wai-Ho Au. 1997a. An effective algorithm for mining interesting quantitative association rules. In Proceedings of the 1997 ACM symposium on Applied computing. ACM, San Jose, CA, United States, 88–90.
  26. Keith CC Chan and Wai-Ho Au. 1997b. Mining fuzzy association rules. In Proceedings of the sixth international conference on information and knowledge management. ACM, Las Vegas Nevada USA, 209–215.
  27. Handling multiple objectives with particle swarm optimization. IEEE Transactions on Evolutionary Computation 8, 3 (2004), 256–279. https://doi.org/10.1109/TEVC.2004.826067
  28. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 2 (2002), 182–197. https://doi.org/10.1109/4235.996017
  29. Xin Dong and Dechang Pi. 2014. An Effective Method for Mining Quantitative Association Rules with Clustering Partition in Satellite Telemetry Data. In 2014 Second International Conference on Advanced Cloud and Big Data. IEEE, Huangshan, China, 26–33. https://doi.org/10.1109/CBD.2014.12
  30. Ant colony optimization. IEEE Computational Intelligence Magazine 1, 4 (2006), 28–39. https://doi.org/10.1109/MCI.2006.329691
  31. Agoston E Eiben and James E Smith. 2015. Introduction to evolutionary computing. Springer, Berlin Heidelberg New York.
  32. Larry J. Eshelman. 1991. The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination. In Foundations of Genetic Algorithms, GREGORY J.E. RAWLINS (Ed.). Vol. 1. Elsevier, 265–283. https://doi.org/10.1016/B978-0-08-050684-5.50020-3
  33. Machine Learning Based Quantitative Association Rule Mining Method for Evaluating Cellular Network Performance. IEEE Access 7 (2019), 166815–166822. https://doi.org/10.1109/ACCESS.2019.2953943
  34. Differential Evolution for Association Rule Mining Using Categorical and Numerical Attributes. In Intelligent Data Engineering and Automated Learning – IDEAL 2018, Hujun Yin, David Camacho, Paulo Novais, and Antonio J. Tallón-Ballesteros (Eds.). Springer International Publishing, Cham, 79–88.
  35. Improved Nature-Inspired Algorithms for Numeric Association Rule Mining. In Intelligent Computing and Optimization, Pandian Vasant, Ivan Zelinka, and Gerhard-Wilhelm Weber (Eds.). Springer International Publishing, Cham, 187–195.
  36. Mining optimized association rules for numeric attributes. J. Comput. System Sci. 58, 1 (1999), 1–12.
  37. Liqiang Geng and Howard J. Hamilton. 2006. Interestingness Measures for Data Mining: A Survey. ACM Comput. Surv. 38, 3 (sep 2006), 9–es. https://doi.org/10.1145/1132960.1132963
  38. Ashish Ghosh and Bhabesh Nath. 2004. Multi-objective rule mining using genetic algorithms. Information Sciences 163, 1 (2004), 123–133. https://doi.org/10.1016/j.ins.2003.03.021 Soft Computing Data Mining.
  39. Anjana Gosain and Maneela Bhugra. 2013. A comprehensive survey of association rules on quantitative data in data mining. In 2013 IEEE Conference on Information & Communication Technologies. IEEE, India, 1003–1008.
  40. An Effective Algorithm for Mining Quantitative Association Rules Based on High Dimension Cluster. In 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing. IEEE, Dalian, China, 1–4. https://doi.org/10.1109/WiCom.2008.2663
  41. Function approximation repository.
  42. Attila Gyenesei. 2001. A Fuzzy Approach for Mining Quantitative Association Rules. Acta Cybern. 15 (2001), 305–320.
  43. Mining frequent patterns without candidate generation: A frequent-pattern tree approach. Data mining and knowledge discovery 8, 1 (2004), 53–87.
  44. Multi-objective bat algorithm for mining numerical association rules. International Journal of Bio-Inspired Computation 11, 4 (2018), 239–248.
  45. Jhon H HOLLAND. 1992. Adaption in Natural and Artificial Systems:an introductory analysis with applications to biology, control, and artificial intelligence. MIT press, USA.
  46. Mining association rules from quantitative data. Intelligent data analysis 3, 5 (1999), 363–376.
  47. Cognitive computing and rule extraction in generalized one-sided formal contexts. Cognitive Computation 14, 6 (2022), 2087–2107.
  48. Numerical Association Rule Mining from a Defined Schema Using the VMO Algorithm. Applied Sciences 11, 13 (2021), 21. https://doi.org/10.3390/app11136154
  49. Irene Kahvazadeh and Mohammad Saniee Abadeh. 2015. MOCANAR: a multi-objective cuckoo search algorithm for numeric association rule discovery. Computer Science & Information Technology 99 (2015), 113.
  50. Bipartition techniques for quantitative attributes in association rule mining. In TENCON 2009-2009 IEEE Region 10 Conference. IEEE, Singapore, 1–6.
  51. Impact-Driven Discretization of Numerical Factors: Case of Two- and Three-Partitioning. In Big Data Analytics. Springer International Publishing, Cham, 244–260.
  52. On the Potential of Numerical Association Rule Mining. In International Conference on Future Data and Security Engineering. Springer, Vietnam, 3–20.
  53. A Systematic Assessment of Numerical Association Rule Mining Methods. SN Computer Science 2, 5 (2021), 1–13.
  54. An Analysis of Human Perception of Partitions of Numerical Factor Domains. In Information Integration and Web Intelligence, Eric Pardede, Pari Delir Haghighi, Ismail Khalil, and Gabriele Kotsis (Eds.). Springer Nature Switzerland, Cham, 137–144.
  55. Discretizing Numerical Attributes: An Analysis of Human Perceptions. In New Trends in Database and Information Systems. Springer International Publishing, Cham, 188–197.
  56. An information-theoretic approach to quantitative association rule mining. Knowledge and Information Systems 16, 2 (2008), 213–244.
  57. James Kennedy and Russell Eberhart. 1995. Particle swarm optimization. In Proceedings of ICNN’95-international conference on neural networks, Vol. 4. IEEE, Australia, 1942–1948.
  58. Supervised Dynamic and Adaptive Discretization for Rule Mining. In SDM Workshop on Big Data and Stream Analytics, 2015.
  59. Fuzzy clustering-based discretization for gene expression classification. Knowledge and Information Systems 24, 3 (2010), 441–465.
  60. John R Koza. 1994. Genetic programming as a means for programming computers by natural selection. Statistics and computing 4 (1994), 87–112. https://doi.org/10.1007/BF00175355
  61. Multi-objective particle swarm optimization algorithm using adaptive archive grid for numerical association rule mining. Neural Computing and Applications 31, 8 (2019), 3559–3572.
  62. Mining Fuzzy Association Rules in Databases. SIGMOD Rec. 27, 1 (mar 1998), 41–46. https://doi.org/10.1145/273244.273257
  63. A Discrete Crow Search Algorithm for Mining Quantitative Association Rules. International Journal of Swarm Intelligence Research (IJSIR) 12, 4 (2021), 101–124.
  64. Keon-Myung Lee. 2001. Mining generalized fuzzy quantitative association rules with fuzzy generalization hierarchies. In Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569), Vol. 5. IEEE, Canada, 2977–2982. https://doi.org/10.1109/NAFIPS.2001.943701
  65. Clustering association rules. In Proceedings 13th International Conference on Data Engineering. IEEE, Birmingham, UK, 220–231.
  66. An Adaptive Method of Numerical Attribute Merging for Quantitative Association Rule Mining. In Internet Applications, Lucas Chi Kwong Hui and Dik-Lun Lee (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 41–50.
  67. An efficient algorithm for finding dense regions for mining quantitative association rules. Computers & Mathematics with Applications 50, 3-4 (2005), 471–490.
  68. M. Lichman. 2013. UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. http://archive.ics.uci.edu/ml Publication Title: UCI Machine Learning Repository.
  69. A density-based fuzzy adaptive clustering algorithm. Chinese Journal of Engineering 36, 20141120 (2014), 1560. https://doi.org/10.13374/j.issn1001-053x.2014.11.020
  70. Marcus-Christopher Lud and Gerhard Widmer. 2000. Relative Unsupervised Discretization for Association Rule Mining. In Principles of Data Mining and Knowledge Discovery. Springer Berlin Heidelberg, Berlin, Heidelberg, 148–158.
  71. Mining exceptional relationships with grammar-guided genetic programming. Knowledge and Information Systems 47, 3 (2016), 571–594.
  72. Reducing gaps in quantitative association rules: A genetic programming free-parameter algorithm. Integrated Computer-Aided Engineering 21, 4 (2014), 321–337.
  73. An evolutionary algorithm to discover quantitative association rules in multidimensional time series. Soft Computing 15, 10 (2011), 2065–2084.
  74. Mining quantitative association rules based on evolutionary computation and its application to atmospheric pollution. Integrated Computer-Aided Engineering 17, 3 (2010), 227–242.
  75. Improving a multi-objective evolutionary algorithm to discover quantitative association rules. Knowledge and Information Systems 49, 2 (2016), 481–509.
  76. NICGAR: A Niching Genetic Algorithm to mine a diverse set of interesting quantitative association rules. Information Sciences 355-356 (2016), 208–228. https://doi.org/10.1016/j.ins.2016.03.039
  77. A New Multiobjective Evolutionary Algorithm for Mining a Reduced Set of Interesting Positive and Negative Quantitative Association Rules. IEEE Transactions on Evolutionary Computation 18, 1 (2014), 54–69. https://doi.org/10.1109/TEVC.2013.2285016
  78. QAR-CIP-NSGA-II: A new multi-objective evolutionary algorithm to mine quantitative association rules. Information Sciences 258 (2014), 1–28. https://doi.org/10.1016/j.ins.2013.09.009
  79. Mining numeric association rules with genetic algorithms. In Artificial neural nets and genetic algorithms. Springer, Czech Republic, 264–267.
  80. Discovering numeric association rules via evolutionary algorithm. In Pacific-Asia conference on knowledge discovery and data mining. Springer, Taiwan, 40–51.
  81. Combining Graph Clustering and Quantitative Association Rules for Knowledge Discovery in Geochemical Data Problem. IEEE Access 8 (2020), 40453–40473. https://doi.org/10.1109/ACCESS.2019.2948800
  82. R. J. Miller and Y. Yang. 1997. Association Rules over Interval Data. In SIGMOD ’97. Association for Computing Machinery, New York, NY, USA, 452–461. https://doi.org/10.1145/253260.253361
  83. Mining numerical association rules via multi-objective genetic algorithms. Information Sciences 233 (2013), 15–24. https://doi.org/10.1016/j.ins.2013.01.028
  84. A method for mining association rules in quantitative and fuzzy data. In 2009 International Conference on Computers Industrial Engineering. IEEE, France, 453–458. https://doi.org/10.1109/ICCIE.2009.5223873
  85. Katherine Moreland and Klaus Truemper. 2009. Discretization of target attributes for subgroup discovery. In International Workshop on Machine Learning and Data Mining in Pattern Recognition. Springer, Germany, 44–52.
  86. F. Moslehi and A. Haeri. 2020. A genetic algorithm-based framework for mining quantitative association rules without specifying minimum support and minimum confidence. Scientia Iranica 27, 3 (2020), 1316–1332. https://doi.org/10.24200/sci.2019.51030.1969
  87. A novel hybrid GA-PSO framework for mining quantitative association rules. soft computing 24, 6 (2020), 4645–4666.
  88. Multi-objective numeric association rules mining via ant colony optimization for continuous domains without specifying minimum support and minimum confidence. International Journal of Computer Science Issues (IJCSI) 8, 5 (2011), 34.
  89. Gregory Piatetsky-Shapiro. 1991. Discovery, Analysis, and Presentation of Strong Rules. In Knowledge Discovery in Databases, Gregory Piatetsky-Shapiro and William J. Frawley (Eds.). AAAI/MIT Press, 229–248.
  90. Variable mesh optimization for continuous optimization problems. Soft Computing 16, 3 (2012), 511–525.
  91. GSA: a gravitational search algorithm. Information sciences 179, 13 (2009), 2232–2248.
  92. R. Rastogi and Kyuseok Shim. 2002. Mining optimized association rules with categorical and numeric attributes. IEEE Transactions on Knowledge and Data Engineering 14, 1 (2002), 29–50. https://doi.org/10.1109/69.979971
  93. QuantMiner: A Genetic Algorithm for Mining Quantitative Association Rules. In IJCAI, Vol. 7. Morgan Kaufmann Publishers Inc., India, 1035–1040.
  94. Expected vs. unexpected: selecting right measures of interestingness. In Big Data Analytics and Knowledge Discovery, Vol. 12393. Springer International Publishing, Cham, 38–47.
  95. Chunyao Song and Tingjian Ge. 2013. Discovering and Managing Quantitative Association Rules. In Proceedings of the 22nd ACM International Conference on Information & Knowledge Management (CIKM ’13). Association for Computing Machinery, New York, NY, USA, 2429–2434. https://doi.org/10.1145/2505515.2505611
  96. Ramakrishnan Srikant and Rakesh Agrawal. 1996. Mining quantitative association rules in large relational tables. In Proceedings of the 1996 ACM SIGMOD international conference on Management of data. ACM, Canada, 1–12.
  97. Rainer Storn and Kenneth Price. 1997. Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. Journal of global optimization 11, 4 (1997), 341–359.
  98. Association rule mining for continuous attributes using genetic network programming. IEEJ transactions on electrical and electronic engineering 3, 2 (2008), 199–211.
  99. Imam Tahyudin and Hidetaka Nambo. 2019. Improved optimization of numerical association rule mining using hybrid particle swarm optimization and cauchy distribution. International Journal of Electrical and Computer Engineering 9, 2 (2019), 1359.
  100. Tomohiro Takagi and Michio Sugeno. 1985. Fuzzy identification of systems and its applications to modeling and control. IEEE Transactions on Systems, Man, and Cybernetics SMC-15, 1 (1985), 116–132. https://doi.org/10.1109/TSMC.1985.6313399
  101. Selecting the right objective measure for association analysis. Information Systems 29, 4 (2004), 293–313.
  102. Wolf search algorithm with ephemeral memory. In Seventh International Conference on Digital Information Management (ICDIM 2012). IEEE, Macao, 165–172.
  103. A survey of evolutionary computation for association rule mining. Information Sciences 524 (2020), 318–352. https://doi.org/10.1016/j.ins.2020.02.073
  104. Interestingness-Based Interval Merger for Numeric Association Rules. In KDD, Vol. 98. AAAI Press, New York, 121–128.
  105. Fuzzy Inference Algorithm based on Quantitative Association Rules. Procedia Computer Science 61 (12 2015), 388–394. https://doi.org/10.1016/j.procs.2015.09.166
  106. Geoffrey I Webb. 2001. Discovering associations with numeric variables. In Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, San Francisco California, 383–388.
  107. PPQAR: parallel PSO for quantitative association rule mining. Peer-to-Peer Networking and Applications 12, 5 (2019), 1433–1444.
  108. Genetic algorithm-based strategy for identifying association rules without specifying actual minimum support. Expert Systems with Applications 36, 2 (2009), 3066–3076.
  109. Junrui Yang and Zhang Feng. 2010. An effective algorithm for mining quantitative associations based on subspace clustering. In 2010 International Conference on Networking and Digital Society, Vol. 1. IEEE, China, 175–178. https://doi.org/10.1109/ICNDS.2010.5479600
  110. Xin-She Yang. 2010. A new metaheuristic bat-inspired algorithm. In Nature inspired cooperative strategies for optimization (NICSO 2010). Springer, 65–74.
  111. Xin-She Yang and Suash Deb. 2009. Cuckoo search via Lévy flights. In 2009 World congress on nature & biologically inspired computing (NaBIC). IEEE, India, 210–214.
  112. Mohammed Javeed Zaki. 2000. Scalable algorithms for association mining. IEEE transactions on knowledge and data engineering 12, 3 (2000), 372–390. https://doi.org/10.1109/69.846291
  113. Weining Zhang. 1999. Mining fuzzy quantitative association rules. In Proceedings 11th International Conference on Tools with Artificial Intelligence. IEEE, USA, 99–102.
  114. Optimized fuzzy association rule mining for quantitative data. In 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). IEEE, China, 396–403.
Citations (14)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now