SkinVisualNet: A Hybrid Deep Learning Approach Leveraging Explainable Models for Identifying Lyme Disease from Skin Rash Images

Amir Sohel, Rittik Chandra Das Turjy, Sarbajit Paul Bappy, Md Assaduzzaman, Ahmed Al Marouf, Jon George Rokne, Reda Alhajj

Lyme disease, caused by the Borrelia burgdorferi bacterium and transmitted through black-legged (deer) tick bites, is becoming increasingly prevalent globally. According to data from the Lyme Disease Association, the number of cases has surged by more than 357% over the past 15 years. According to the Infectious Disease Society of America, traditional diagnostic methods are often slow, potentially allowing bacterial proliferation and complicating early management. This study proposes a novel hybrid deep learning framework to classify Lyme disease rashes, addressing the global prevalence of the disease caused by the Borrelia burgdorferi bacterium, which is transmitted through black-legged (deer) tick bites. This study presents a novel hybrid deep learning framework for classifying Lyme disease rashes, utilizing pre-trained models (ResNet50 V2, VGG19, DenseNet201) for initial classification. By combining VGG19 and DenseNet201 architectures, we developed a hybrid model, SkinVisualNet, which achieved an impressive accuracy of 98.83%, precision of 98.45%, recall of 99.09%, and an F1 score of 98.76%. To ensure the robustness and generalizability of the model, 5-fold cross-validation (CV) was performed, generating an average validation accuracy between 98.20% and 98.92%. Incorporating image preprocessing techniques such as gamma correction, contrast stretching and data augmentation led to a 10–13% improvement in model accuracy, significantly enhancing its ability to generalize across various conditions and improving overall performance. To improve model interpretability, we applied Explainable AI methods like LIME, Grad-CAM, CAM++, Score CAM and Smooth Grad to visualize the rash image regions most influential in classification. These techniques enhance both diagnostic transparency and model reliability, helping clinicians better understand the diagnostic decisions. The proposed framework demonstrates a significant advancement in automated Lyme disease detection, providing a robust and explainable AI-based diagnostic tool that can aid clinicians in improving patient outcomes.