decorrelated_batch_normalization(x, *, groups=16, eps=2e-5, running_mean=None, running_projection=None, decay=0.9)¶
Decorrelated batch normalization function.
It takes the input variable
xand normalizes it using batch statistics to make the output zero-mean and decorrelated.
Variable) – Input variable.
groups (int) – Number of groups to use for group whitening.
eps (float) – Epsilon value for numerical stability.
running_mean (N-dimensional array) – Expected value of the mean. This is a running average of the mean over several mini-batches using the decay parameter. If
None, the expected mean is initialized to zero.
running_projection (N-dimensional array) – Expected value of the project matrix. This is a running average of the projection over several mini-batches using the decay parameter. If
None, the expected projected is initialized to the identity matrix.
decay (float) – Decay rate of moving average. It is used during training.
The output variable which has the same shape as \(x\).
- Return type