Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

The Forward-Forward Algorithm as a feature extractor for skin lesion classification: A preliminary study (2307.00617v1)

Published 2 Jul 2023 in cs.CV, cs.AI, and cs.LG

Abstract: Skin cancer, a deadly form of cancer, exhibits a 23\% survival rate in the USA with late diagnosis. Early detection can significantly increase the survival rate, and facilitate timely treatment. Accurate biomedical image classification is vital in medical analysis, aiding clinicians in disease diagnosis and treatment. Deep learning (DL) techniques, such as convolutional neural networks and transformers, have revolutionized clinical decision-making automation. However, computational cost and hardware constraints limit the implementation of state-of-the-art DL architectures. In this work, we explore a new type of neural network that does not need backpropagation (BP), namely the Forward-Forward Algorithm (FFA), for skin lesion classification. While FFA is claimed to use very low-power analog hardware, BP still tends to be superior in terms of classification accuracy. In addition, our experimental results suggest that the combination of FFA and BP can be a better alternative to achieve a more accurate prediction.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (24)
  1. Albahar, M. A. Skin lesion classification using convolutional neural network with novel regularizer. IEEE Access, 7:38306–38313, 2019.
  2. Amari, S.-i. Backpropagation and stochastic gradient descent method. Neurocomputing, 5(4-5):185–196, 1993.
  3. Artificial intelligence in cancer research and precision medicine. Cancer discovery, 11(4):900–915, 2021.
  4. An improvement of the convergence proof of the adam-optimizer. arXiv preprint arXiv:1804.10587, 2018.
  5. Skin lesion analysis toward melanoma detection: A challenge at the international symposium on biomedical imaging (isbi) 2016, hosted by the international skin imaging collaboration (isic). arXiv preprint arXiv:1605.01397, 2016.
  6. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp.  297–304. JMLR Workshop and Conference Proceedings, 2010.
  7. Harangi, B. Skin lesion classification with ensembles of deep convolutional neural networks. Journal of biomedical informatics, 86:25–32, 2018.
  8. Hinton, G. The forward-forward algorithm: Some preliminary investigations. arXiv preprint arXiv:2212.13345, 2022.
  9. Learning and relearning in boltzmann machines. Parallel distributed processing: Explorations in the microstructure of cognition, 1(282-317):2, 1986.
  10. Federated learning for resource-constrained iot devices: Panoramas and state of the art. Federated and Transfer Learning, pp.  7–27, 2022.
  11. Training end-to-end analog neural networks with equilibrium propagation. arXiv preprint arXiv:2006.01981, 2020.
  12. Langley, P. Crafting papers on machine learning. In Langley, P. (ed.), Proceedings of the 17th International Conference on Machine Learning (ICML 2000), pp.  1207–1216, Stanford, CA, 2000. Morgan Kaufmann.
  13. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324, 1998.
  14. Skin cancer. Primary care: Clinics in office practice, 42(4):645–659, 2015.
  15. Skin lesion classification using hybrid deep neural networks. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.  1229–1233. IEEE, 2019.
  16. Cancer treatment and survivorship statistics, 2019. CA: a cancer journal for clinicians, 69(5):363–385, 2019.
  17. Ororbia, A. Learning spiking neural systems with the event-driven forward-forward process. arXiv preprint arXiv:2303.18187, 2023.
  18. Skin lesion classification using gan based data augmentation. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp.  916–919. IEEE, 2019.
  19. Learning internal representations by error propagation. Technical report, California Univ San Diego La Jolla Inst for Cognitive Science, 1985.
  20. Learning representations by back-propagating errors. nature, 323(6088):533–536, 1986.
  21. Cancer statistics, 2023. CA: a cancer journal for clinicians, 73(1):17–48, 2023.
  22. The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientific data, 5(1):1–9, 2018.
  23. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  24. Attention residual learning for skin lesion classification. IEEE transactions on medical imaging, 38(9):2092–2103, 2019.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now