The Open UniversitySkip to content

The Metric Structure of Weight Space

Rüger, Stefan and Ossen, Arnfried (1997). The Metric Structure of Weight Space. Neural Processing Letters, 5(2) pp. 1–9.

DOI (Digital Object Identifier) Link:
Google Scholar: Look up in Google Scholar


We describe symmetries of feedforward networks in terms of their corresponding groups, which naturally act on and partition weight space. This leads to an algorithm that generates representative weight vectors in a specific fundamental domain. The closure of this domain turns out to be a manifold with singular points. We derive a canonical metric for the manifold that can be implemented efficiently even for large networks. One application would be the clustering of resulting weight vectors of an experiment in order to identify inadequate models or learning methods.

Item Type: Journal Article
ISSN: 1370-4621
Academic Unit/Department: Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi)
Faculty of Science, Technology, Engineering and Mathematics (STEM)
Item ID: 11958
Depositing User: Users 8580 not found.
Date Deposited: 08 Oct 2008 13:15
Last Modified: 04 Oct 2016 10:13
Share this page:


Scopus Citations

▼ Automated document suggestions from open access sources

Actions (login may be required)

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340