Flexible K Nearest Neighbors Classifier: Derivation and Application for Ion-mobility Spectrometry-based Indoor Localization (2304.10151v3)
Abstract: The K Nearest Neighbors (KNN) classifier is widely used in many fields such as fingerprint-based localization or medicine. It determines the class membership of unlabelled sample based on the class memberships of the K labelled samples, the so-called nearest neighbors, that are closest to the unlabelled sample. The choice of K has been the topic of various studies and proposed KNN-variants. Yet no variant has been proven to outperform all other variants. In this paper a KNN-variant is discussed which ensures that the K nearest neighbors are indeed close to the unlabelled sample and finds K along the way. The algorithm is tested and compared to the standard KNN in theoretical scenarios and for indoor localization based on ion-mobility spectrometry fingerprints. It achieves a higher classification accuracy than the KNN in the tests, while having the same computational demand.
- J.L. Bentley, “A survey of techniques for fixed radius near neighbor searching,” Technical Report SLAC-186 and STAN-CS-75-513, Stanford Linear Accelerator Center, August 1975
- C. Levinthal, “Molecular model-building by computer,” Scientific American 214, pp. 42–52. June 1966.
- A. Król, W. Rzasa, and P. Grochowalski, “Aggregation of Fuzzy Equivalences in Data Exploration by kNN Classifier,” IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2020), July 2020.
- Z. Wang, Y. L, D. Li, Z. Zhu, and W. Du, “Entropy and gravitation based dynamic radius nearest neighbor classification for imbalanced problem,” Knowledge-Based Systems 193 Article 105474, January 2020.
- P. Grochowalski, A. Król, and W. Rzasa, “Radius kNN classifier using aggregation of fuzzy equivalences,” IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2021), July 2021.
- A. Onyezewe, A. F. Kana, F. B. Abdullahi, and A. O. Abdulsalami, “An Enhanced Adaptive k-Nearest Neighbor Classifier Using Simulated Annealing,” I. J. Intelligent Systems and Applications, vol. 1, pp. 34–44, February 2021.
- Z. Bian, C. M. Vong, P. K. Wong, and S. Wang, “Fuzzy KNN method with adaptive nearest neighbors,” IEEE Transactions on Cybernetics, vol. 52 (6), pp. 5380–5393, June 2022.
- P. Müller, M. Raitoharju, and R. Piché, “A field test of parametric WLAN-fingerprint-positioning methods,” 17th International Conference on Information Fusion (FUSION), July 2014.
- M. Alkasassbeh, G. Altarawneh, and A. Hassanat, “On enhancing the performance of nearest neighbour classifiers using hassanat distance metric,” Can. J. Pure Appl. Sci., vol. 9 (1), pp. 1–6, February 2015.
- S. Uddin, I. Haque, H. Lu, M. A. Moni, and E. Gide, “Comparative performance analysis of K‐nearest neighbour (KNN) algorithm and its different variants for disease prediction,” Scientific Reports, vol. 12, 6256, April 2022.
- G. Minaev, P. Müller, A. Visa, and R. Piché, “Indoor localisation using aroma fingerprints: Comparing nearest neighbour classification accuracy using different distance measures,” 7th International Conference on Systems and Control (ICSC’18), October 2018.
- D. Wettschereck and T. G. Dietterich, “Locally adaptive nearest neighbor algorithms,” Proceedings of the 6th International Conference on Neural Information Processing Systems (NIPS’93), pp. 184–191, November 1993
- Z. Pan, Y. Wang, and Y. Pan, “A new locally adaptive k-nearest neighbor algorithm based on discrimination class,” Knowledge-based Systems, vol. 204, 106185, September 2020.
- A. B. Hassanat, M. A. Abbadi, G. A. Altarawneh, and A. A. Alhasanat, “Solving the problem of the K parameter in the KNN classifier using an ensemble learning approach,” International Journal of Computer Science and Information Security, Vol. 12, No. 8, August 2014.
- J. Wang, P. Neskovic, and L. N. Cooper, “Neighborhood size selection in the k-nearest-neighbor rule using statistical confidence,” Pattern Recognition, vol. 39 (3), pp. 417–423, March 2006.
- D. Cheng, S. Zhang, Z. Deng, Y. Zhu, and M. Zong, 2014. “kNN algorithm with data-driven k value,” Proceedings of the 10th International Conference on Advanced Data Mining and Applications (ADMA 2014), vol. 8933, pp. 499–512, 2014.
- S. Zhang, X. Li, M. Zong, X. Zhu, and R. Wang, “Efficient kNN classification with different numbers of nearest neighbors,” IEEE Transactions on Neural Networks and Learning Systems, vol. 29 (5), pp. 1774–1785, February 2017.
- R. Montoliu, A. Pérez-Navarro, and J. Torres-Sospedra, “Efficient tuning of kNN hyperparameters for indoor positioning with N-TBEA,” 2022 14th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), October 2022.
- L. Jiang, Z. Chi, D. Wang, and S. Jiang, “Survey of Improving K-Nearest-Neighbor for Classification,” Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007), pp. 679–683, August 2007.
- P. Müller, S. Ali-Löytty, J. Lekkala, R. Piché, “Indoor Localisation using Aroma Fingerprints: A First Sniff,” 14th Workshop in Positioning, Navigation and Communication (WPNC’17), October 2017.