ML0037 Bias in NN

Bias in Neural Networks is used to introduce flexibility and adaptability in learning.
(1) Shifts Activation Threshold: Allows a neuron’s activation function to move left or right, so it can fire even when inputs sum to zero.
(2) Avoids Origin Constraint: Lets decision boundaries and fitted functions not be forced through the origin (0,0).
(3) Increases Flexibility: Provides an extra learnable parameter for better approximation of complex functions.
(4) Compensates for Imbalance: Helps adjust for biases in data or features.