The Metric Structure of Weight Space

Rüger, Stefan and Ossen, Arnfried (1997). The Metric Structure of Weight Space. Neural Processing Letters, 5(2) pp. 1–9.

DOI: https://doi.org/10.1023/A:1009657318698

Abstract

We describe symmetries of feedforward networks in terms of their corresponding groups, which naturally act on and partition weight space. This leads to an algorithm that generates representative weight vectors in a specific fundamental domain. The closure of this domain turns out to be a manifold with singular points. We derive a canonical metric for the manifold that can be implemented efficiently even for large networks. One application would be the clustering of resulting weight vectors of an experiment in order to identify inadequate models or learning methods.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI