tf.nn.leaky_relu

leaky_relu(
    features,
    alpha=0.2,
    name=None
)

Defined in tensorflow/python/ops/nn_ops.py.

Compute the Leaky ReLU activation function.

"Rectifier Nonlinearities Improve Neural Network Acoustic Models" AL Maas, AY Hannun, AY Ng - Proc. ICML, 2013 http://web.stanford.edu/~awni/papers/relu_hybrid_icml2013_final.pdf

Args:

• features: A Tensor representing preactivation values.
• alpha: Slope of the activation function at x < 0.
• name: A name for the operation (optional).

Returns:

The activation value.