The impact of memory on learning sequence-to-sequence tasks - Seif, Alireza; Loos, Sarah A M; Tucci, Gennaro; Roldán, Édgar; Goldt, Sebastian (Machine learning: science and technology, 2024)
Keywords: Artificial neural networks; auto-regressive model; Autoregressive models; Learning; memory; Memory tasks; Natural language processing; Neural networks; non-Markovianity; Performance degradation; Performance enhancement; recurrent neural network; sequence-to-sequence task; statistical physics