chainer.initializers.LeCunNormal

class chainer.initializers.LeCunNormal(scale=1.0, dtype=None)[source]

Initializes array with scaled Gaussian distribution.

Each element of the array is initialized by the value drawn independently from Gaussian distribution whose mean is 0, and standard deviation is \(scale \times \sqrt{\frac{1}{fan_{in}}}\), where \(fan_{in}\) is the number of input units.

Reference: LeCun 98, Efficient Backprop http://yann.lecun.com/exdb/publis/pdf/lecun-98b.pdf

Parameters:
  • scale (float) – A constant that determines the scale of the standard deviation.
  • dtype – Data type specifier.

Methods

__call__(array)[source]

Initializes given array.

This method destructively changes the value of array. The derived class is required to implement this method. The algorithms used to make the new values depend on the concrete derived classes.

Parameters:array (numpy.ndarray or cupy.ndarray) – An array to be initialized by this initializer.