Leaky ReLU Apply the leaky ReLU activation, scaling negatives by a small slope. Description Apply the leaky ReLU activation, scaling negatives by a small slope.