ReLU Apply the rectified linear activation, flooring negatives at zero. Description Apply the rectified linear activation, flooring negatives at zero.