Affine symmetries and neural network identifiability

• Published in: Advances in mathematics (New York. 1965) Vol. 376; p. 107485
• Main Authors: Vlačić, Verner, Bölcskei, Helmut
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 06.01.2021
• Subjects: Affine symmetries; Analytic continuation; Neural network identifiability; Neural network parametrization; tanh; Neural network parametrization; tanh; Neural network identifiability; Analytic continuation; Affine symmetries

We address the following question of neural network identifiability: Suppose we are given a function f:Rm→Rn and a nonlinearity ρ. Can we specify the architecture, weights, and biases of all feed-forward neural networks with respect to ρ giving rise to f? Existing literature on the subject suggests...