Time Series-to-Image Encoding for Classification Using Convolutional Neural Networks: A Novel and Robust Approach

Hammoud Al Joumaa, Loui Al-Shrouf, Mohieddine Jelali

In recent decades, data collection technologies have evolved to facilitate the monitoring and improvement of numerous activities and processes in everyday human life. Their evolution is propelled by the advancement of artificial intelligence (AI), which aims to emulate human intelligence in the execution of related tasks. The remarkable success of deep learning (DL) and computer vision (CV) on image data prompted researchers to consider its application to time series and multivariate data. In this context, time series imaging has been identified as the research field for the transformation of time series data (a one-dimensional data format) into images (a two-dimensional data format). These data can be the variables or features of a system or phenomenon under consideration. State-of-the-art techniques for time series imaging include recurrence plot (RP), Gramian angular field (GAF), and Markov transition field (MTF). This paper proposes a novel, robust, and simple technique of time series imaging using Grayscale Fingerprint Features Field Imaging (G3FI). This novel technique is distinguished by the low resolution of the resulting image and the simplicity of the transformation procedure. The efficacy of the novel and state-of-the-art techniques for enhancing the performance of CNN-based classification models on time series datasets is thoroughly examined and compared.