Human trajectory prediction and generation using LSTM models and GANs

• Published in: Pattern recognition Vol. 120; p. 108136
• Main Authors: Rossi, Luca, Paolanti, Marina, Pierdicca, Roberto, Frontoni, Emanuele
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.12.2021
• Subjects: GANs; LSTM; Trajectory generation; Trajectory prediction; Trajectory prediction; Trajectory generation; LSTM; GANs
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2021.108136

•New deep neural network models are proposed for trajectory prediction.•LSTM and GAN1 models are used for unimodal predictions, GAN3 model for multimodal.•Metrics are proposed for normalizing errors for more consistent comparisons.•New dataset are proposed with low linearity and a high diversity. Human trajectory prediction is an important topic in several application domains, ranging from self-driving cars to environment design and planning, from socially-aware robots to intelligent tracking systems. This complex subject comes with different challenges, such as human-space interaction, human-human interaction, multimodality, and generalizability. Currently, these challenges, especially generalizability, have not been completely explored by state-of-the-art works. This work attempts to fill this gap by proposing and defining new methods and metrics to help understand trajectories. In particular, new deep learning models based on Long Short-Term Memory and Generative Adversarial Network architectures are used in both unimodal and multimodal contexts. These approaches are evaluated with new error metrics, which normalize some biases in standard metrics. Tests have been assessed using newly collected datasets characterized by a higher diversity and lower linearity than those used in state-of-the-art works. The results prove that the proposed models and datasets are comparable to and yield better generalizability than state-of-the-art works. Moreover, we also prove that our datasets better represent multimodal scenarios (allowing for multiple possible behaviors) and that human trajectories are moderately influenced by their spatial region and slightly influenced by their date and time.