Generative AI and Transformers in Advanced Skin Lesion Classification applied on a mobile device

Authors

  • Erick Garcia-Espinosa Universidad Autónoma del Estado de México, Centro Universitario UAEM Texcoco
  • José Sergio Ruiz-Castilla Universidad Autónoma del Estado de México, Centro Universitario UAEM Texcoco
  • Farid Garcia-Lamont Universidad Autónoma del Estado de México, Centro Universitario UAEM Texcoco

DOI:

https://doi.org/10.61467/2007.1558.2025.v16i2.1078

Keywords:

Generative Adversarial Network, Transformers

Abstract

This research work focuses on the development of a device. Such a device could assist doctors in level 1 and 2 healthcare clinics in Mexico. Because, such clinics lack specialists. The device takes pictures of the patient's skin. The pictures allow to identify diseases and provide a preliminary diagnosis. With the pre-diagnosis it is possible to send the patient to the corresponding specialist. We built a Vision Transformer (VIT) model with a Raspberry Pi 4. The system leverages a dataset augmented by a Generative Adversarial Network (GAN) using Stable Diffusion. The addition of synthetic data significantly improved the performance metrics. Accuracy increased from 90.76% to 92.77%, and the macro average and weighted average F1 scores increased from 0.9076 to 0.9281. Also, improvements were observed in most disease categories. Thus, the model's capacity allows generalization, especially in underrepresented or challenging classes.

Downloads

Published

2025-03-25

How to Cite

Garcia-Espinosa, E. ., Ruiz-Castilla, J. S., & Garcia-Lamont, F. (2025). Generative AI and Transformers in Advanced Skin Lesion Classification applied on a mobile device. International Journal of Combinatorial Optimization Problems and Informatics, 16(2), 158–175. https://doi.org/10.61467/2007.1558.2025.v16i2.1078

Issue

Section

Articles