S. Squartini
A recurrent multiscale architecture for long-term memory prediction task
Squartini, S.; Hussain, A.; Piazza, F.
Abstract
In the past few years, researchers have been extensively studying the application of recurrent neural networks (RNNs) to solving tasks where detection of long term dependencies is required. This paper proposes an original architecture termed the Recurrent Multiscale Network, RMN, to deal with these kinds of problems. Its most relevant properties are concerned with maintaining conventional RNNs' capability of information storing whilst simultaneously attempting to reduce their typical drawback occurring when they are trained by gradient descent algorithms, namely the vanishing gradient effect. This is achieved through RMN which preprocesses the original signal separating information at different temporal scales through an adequate DSP tool, and handling each information level with an autonomous recurrent architecture; the final goal is achieved by a nonlinear reconstruction section. This network has shown a markedly improved generalization performance over conventional RNNs, in its application to time series prediction tasks where long range dependencies are involved.
Citation
Squartini, S., Hussain, A., & Piazza, F. (2003, April). A recurrent multiscale architecture for long-term memory prediction task. Presented at 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)., Hong Kong, China
Presentation Conference Type | Conference Paper (Published) |
---|---|
Conference Name | 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). |
Start Date | Apr 6, 2003 |
End Date | Apr 10, 2003 |
Online Publication Date | Jun 5, 2003 |
Publication Date | 2003 |
Deposit Date | Oct 17, 2019 |
Pages | 789-792 |
Series ISSN | 1520-6149 |
Book Title | 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). |
ISBN | 0-7803-7663-3 |
DOI | https://doi.org/10.1109/ICASSP.2003.1202485 |
Keywords | recurrent neural nets, neural net architecture, time series, prediction theory, discrete wavelet transforms |
Public URL | http://researchrepository.napier.ac.uk/Output/1793724 |
You might also like
Guided Policy Search for Sequential Multitask Learning
(2018)
Journal Article
Learning Latent Features With Infinite Nonnegative Binary Matrix Trifactorization
(2018)
Journal Article
Cross-modality interactive attention network for multispectral pedestrian detection
(2018)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search