Softmax#

Softmax operation applies following formula on every element of src tensor (the variable names follow the standard Conventions):

\[\dst_i = \frac{e^{(\src_i)}}{\sum_{j=1}^{C} e^{\src_j}}\]

where $ C $ is a size of tensor along axis dimension.

Operation Attributes#

Attribute

Name

Description

Value Type

Supported

Values

Required or

Optional

axis

Represents the axis of which the Softmax is calculated.

s64

Arbitrary s64 value (1 in default)

Optional

Execution Arguments#

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs#

Index

Argument Name

Required or Optional

0

src

Required

Outputs#

Index

Argument Name

Required or Optional

0

dst

Required

Supported Data Types#

Softmax operation supports the following data type combinations.

Src

Dst

f32

f32

bf16

bf16

f16

f16