Please use this identifier to cite or link to this item: http://hdl.handle.net/1893/23956
Appears in Collections:Computing Science and Mathematics Journal Articles
Peer Review Status: Refereed
Title: Distributed Reservoir Computing with Sparse Readouts (Forthcoming)
Authors: Scardapane, Simone
Panella, Massimo
Comminiello, Danilo
Hussain, Amir
Uncini, Aurelio
Contact Email: ahu@cs.stir.ac.uk
Keywords: echo state networks
distributed training
prediction
Issue Date: Nov-2016
Publisher: IEEE
Citation: Scardapane S, Panella M, Comminiello D, Hussain A & Uncini A (2016) Distributed Reservoir Computing with Sparse Readouts (Forthcoming), IEEE Computational Intelligence Magazine, 11 (4).
Abstract: In a network of agents, a widespread problem is the need to estimate a common underlying function starting from locally distributed measurements. Real-world scenarios may not allow the presence of centralized fusion centers, requiring the development of distributed, message-passing implementations of the standard machine learning training algorithms. In this paper, we are concerned with the distributed training of a particular class of recurrent neural networks, namely echo state networks (ESNs). In the centralized case, ESNs have received considerable attention, due to the fact that they can be trained with standard linear regression routines. Based on this observation, in our previous work we have introduced a decentralized algorithm, framed in the distributed optimization field, in order to train an ESN. In this paper, we focus on an additional sparsity property of the output layer of ESNs, allowing for very efficient implementations of the resulting networks. In order to evaluate the proposed algorithm, we test it on two well-known prediction benchmarks, namely the Mackey-Glass chaotic time series and the 10th order nonlinear auto regressive moving average (NARMA) system.
Type: Journal Article
URI: http://hdl.handle.net/1893/23956
Rights: (c) 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works
Affiliation: Sapienza University of Rome
Sapienza University of Rome
Sapienza University of Rome
Computing Science - CSM Dept
Sapienza University of Rome

Files in This Item:
File Description SizeFormat 
IEEE-CIM-paper-accepted-Nov2016.pdf303.76 kBAdobe PDFView/Open


This item is protected by original copyright



Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

If you believe that any material held in STORRE infringes copyright, please contact library@stir.ac.uk providing details and we will remove the Work from public display in STORRE and investigate your claim.