GELU#

GELU operation applies following formula on every element of src tensor (the variable names follow the standard Conventions):

\[\dst = 0.5 \src \cdot (1.0 + erf(\src) / \sqrt2)\]

Operation Attributes#

GELU operation does not support any attribute.

Execution Arguments#

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs#

Index

Argument Name

Required or Optional

0

src

Required

Outputs#

Index

Argument Name

Required or Optional

0

dst

Required

Supported Data Types#

GELU operation supports the following data type combinations.

Src

Dst

f32

f32

bf16

bf16

f16

f16