ReLU#

ReLU applies following formula on every element of src tensor (the variable names follow the standard Conventions):

\[\begin{split}\dst = \begin{cases} \src & \text{if}\ \src > 0 \\ 0 & \text{if}\ \src \leq 0 \end{cases}\end{split}\]

Operation Attributes#

ReLU operation does not support any attribute.

Execution Arguments#

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs#

Index

Argument Name

Required or Optional

0

src

Required

Outputs#

Index

Argument Name

Required or Optional

0

dst

Required

Supported Data Types#

ReLU operation supports the following data type combinations.

Src

Dst

f32

f32

bf16

bf16

f16

f16