Rate this Page
★★★★★

Hardshrink#

classtorch.nn.modules.activation.Hardshrink(lambd=0.5)[source]#

Applies the Hard Shrinkage (Hardshrink) function element-wise.

Hardshrink is defined as:

HardShrink(x)={x, if x>λx, if x<−λ0, otherwise \text{HardShrink}(x) =\begin{cases}x, & \text{ if } x > \lambda \\x, & \text{ if } x < -\lambda \\0, & \text{ otherwise }\end{cases}
Parameters

lambd (float) – theλ\lambda value for the Hardshrink formulation. Default: 0.5

Shape:

  • Input:(∗)(*), where∗* means any number of dimensions.

  • Output:(∗)(*), same shape as the input.

../_images/Hardshrink.png

Examples:

>>>m=nn.Hardshrink()>>>input=torch.randn(2)>>>output=m(input)
extra_repr()[source]#

Return the extra representation of the module.

Return type

str

forward(input)[source]#

Run forward pass.

Return type

Tensor