Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
9 tokens/sec
GPT-4o
12 tokens/sec
Gemini 2.5 Pro Pro
40 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Flexible K Nearest Neighbors Classifier: Derivation and Application for Ion-mobility Spectrometry-based Indoor Localization (2304.10151v3)

Published 20 Apr 2023 in cs.LG and eess.SP

Abstract: The K Nearest Neighbors (KNN) classifier is widely used in many fields such as fingerprint-based localization or medicine. It determines the class membership of unlabelled sample based on the class memberships of the K labelled samples, the so-called nearest neighbors, that are closest to the unlabelled sample. The choice of K has been the topic of various studies and proposed KNN-variants. Yet no variant has been proven to outperform all other variants. In this paper a KNN-variant is discussed which ensures that the K nearest neighbors are indeed close to the unlabelled sample and finds K along the way. The algorithm is tested and compared to the standard KNN in theoretical scenarios and for indoor localization based on ion-mobility spectrometry fingerprints. It achieves a higher classification accuracy than the KNN in the tests, while having the same computational demand.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (20)
  1. J.L. Bentley, “A survey of techniques for fixed radius near neighbor searching,” Technical Report SLAC-186 and STAN-CS-75-513, Stanford Linear Accelerator Center, August 1975
  2. C. Levinthal, “Molecular model-building by computer,” Scientific American 214, pp. 42–52. June 1966.
  3. A. Król, W. Rzasa, and P. Grochowalski, “Aggregation of Fuzzy Equivalences in Data Exploration by kNN Classifier,” IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2020), July 2020.
  4. Z. Wang, Y. L, D. Li, Z. Zhu, and W. Du, “Entropy and gravitation based dynamic radius nearest neighbor classification for imbalanced problem,” Knowledge-Based Systems 193 Article 105474, January 2020.
  5. P. Grochowalski, A. Król, and W. Rzasa, “Radius kNN classifier using aggregation of fuzzy equivalences,” IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2021), July 2021.
  6. A. Onyezewe, A. F. Kana, F. B. Abdullahi, and A. O. Abdulsalami, “An Enhanced Adaptive k-Nearest Neighbor Classifier Using Simulated Annealing,” I. J. Intelligent Systems and Applications, vol. 1, pp. 34–44, February 2021.
  7. Z. Bian, C. M. Vong, P. K. Wong, and S. Wang, “Fuzzy KNN method with adaptive nearest neighbors,” IEEE Transactions on Cybernetics, vol. 52 (6), pp. 5380–5393, June 2022.
  8. P. Müller, M. Raitoharju, and R. Piché, “A field test of parametric WLAN-fingerprint-positioning methods,” 17th International Conference on Information Fusion (FUSION), July 2014.
  9. M. Alkasassbeh, G. Altarawneh, and A. Hassanat, “On enhancing the performance of nearest neighbour classifiers using hassanat distance metric,” Can. J. Pure Appl. Sci., vol. 9 (1), pp. 1–6, February 2015.
  10. S. Uddin, I. Haque, H. Lu, M. A. Moni, and E. Gide, “Comparative performance analysis of K‐nearest neighbour (KNN) algorithm and its different variants for disease prediction,” Scientific Reports, vol. 12, 6256, April 2022.
  11. G. Minaev, P. Müller, A. Visa, and R. Piché, “Indoor localisation using aroma fingerprints: Comparing nearest neighbour classification accuracy using different distance measures,” 7th International Conference on Systems and Control (ICSC’18), October 2018.
  12. D. Wettschereck and T. G. Dietterich, “Locally adaptive nearest neighbor algorithms,” Proceedings of the 6th International Conference on Neural Information Processing Systems (NIPS’93), pp. 184–191, November 1993
  13. Z. Pan, Y. Wang, and Y. Pan, “A new locally adaptive k-nearest neighbor algorithm based on discrimination class,” Knowledge-based Systems, vol. 204, 106185, September 2020.
  14. A. B. Hassanat, M. A. Abbadi, G. A. Altarawneh, and A. A. Alhasanat, “Solving the problem of the K parameter in the KNN classifier using an ensemble learning approach,” International Journal of Computer Science and Information Security, Vol. 12, No. 8, August 2014.
  15. J. Wang, P. Neskovic, and L. N. Cooper, “Neighborhood size selection in the k-nearest-neighbor rule using statistical confidence,” Pattern Recognition, vol. 39 (3), pp. 417–423, March 2006.
  16. D. Cheng, S. Zhang, Z. Deng, Y. Zhu, and M. Zong, 2014. “kNN algorithm with data-driven k value,” Proceedings of the 10th International Conference on Advanced Data Mining and Applications (ADMA 2014), vol. 8933, pp. 499–512, 2014.
  17. S. Zhang, X. Li, M. Zong, X. Zhu, and R. Wang, “Efficient kNN classification with different numbers of nearest neighbors,” IEEE Transactions on Neural Networks and Learning Systems, vol. 29 (5), pp. 1774–1785, February 2017.
  18. R. Montoliu, A. Pérez-Navarro, and J. Torres-Sospedra, “Efficient tuning of kNN hyperparameters for indoor positioning with N-TBEA,” 2022 14th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), October 2022.
  19. L. Jiang, Z. Chi, D. Wang, and S. Jiang, “Survey of Improving K-Nearest-Neighbor for Classification,” Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007), pp. 679–683, August 2007.
  20. P. Müller, S. Ali-Löytty, J. Lekkala, R. Piché, “Indoor Localisation using Aroma Fingerprints: A First Sniff,” 14th Workshop in Positioning, Navigation and Communication (WPNC’17), October 2017.

Summary

We haven't generated a summary for this paper yet.