Please use this identifier to cite or link to this item: http://hdl.handle.net/1893/23415
Appears in Collections:Computing Science and Mathematics Journal Articles
Peer Review Status: Refereed
Title: Structure Discovery in Mixed Order Hyper Networks
Authors: Swingler, Kevin
Contact Email: k.m.swingler@cs.stir.ac.uk
Keywords: High order neural networks
Structure discovery
Linkage learning
Issue Date: 1-Oct-2016
Publisher: BioMed Central
Citation: Swingler K (2016) Structure Discovery in Mixed Order Hyper Networks, Big Data Analytics, 1 (1), Art. No.: 8.
Abstract: Background  Mixed Order Hyper Networks (MOHNs) are a type of neural network in which the interactions between inputs are modelled explicitly by weights that can connect any number of neurons. Such networks have a human readability that networks with hidden units lack. They can be used for regression, classification or as content addressable memories and have been shown to be useful as fitness function models in constraint satisfaction tasks. They are fast to train and, when their structure is fixed, do not suffer from local minima in the cost function during training. However, their main drawback is that the correct structure (which neurons to connect with weights) must be discovered from data and an exhaustive search is not possible for networks of over around 30 inputs.  Results  This paper presents an algorithm designed to discover a set of weights that satisfy the joint constraints of low training error and a parsimonious model. The combined structure discovery and weight learning process was found to be faster, more accurate and have less variance than training an MLP.  Conclusions  There are a number of advantages to using higher order weights rather than hidden units in a neural network but discovering the correct structure for those weights can be challenging. With the method proposed in this paper, the use of high order networks becomes tractable.
Type: Journal Article
URI: http://hdl.handle.net/1893/23415
DOI Link: http://dx.doi.org/10.1186/s41044-016-0009-x
Rights: © The Author(s) 2016 This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Affiliation: Computing Science - CSM Dept

Files in This Item:
File Description SizeFormat 
Swingler_BigDataAnalytics_2016.pdf1.5 MBAdobe PDFView/Open


This item is protected by original copyright



Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

If you believe that any material held in STORRE infringes copyright, please contact library@stir.ac.uk providing details and we will remove the Work from public display in STORRE and investigate your claim.