ReLU#

classtorch.nn.ReLU(inplace=False)[source]#

Applies the rectified linear unit function element-wise.

$\text{ReLU}(x)=(x{)}^{+}=\max (0,x)$ReLU(x)=(x)+=max(0,x)

Parameters

inplace (bool) – can optionally do the operation in-place. Default:False

Shape:

• Input:$(\ast )$(∗), where$\ast$∗ means any number of dimensions.

• Output:$(\ast )$(∗), same shape as the input.

Examples:

>>>m=nn.ReLU()>>>input=torch.randn(2)>>>output=m(input)AnimplementationofCReLU-https://arxiv.org/abs/1603.05201>>>m=nn.ReLU()>>>input=torch.randn(2).unsqueeze(0)>>>output=torch.cat((m(input),m(-input)))

extra_repr()[source]#

Return the extra representation of the module.

Return type

str

forward(input)[source]#

Runs the forward pass.

Return type

Tensor