GELUBackprop
GELUBackprop#
Versioned name: GELUBackprop-1
Category: Activation
Short description: GELUBackprop computes gradient for GELU
Inputs:
1:
input_forward
- original input tensor of GELU op. Required.Type: T
2:
output_delta
- the gradient tensor with respect to the output of GELU. Required.Type: T
Outputs
1:
input_delta
- the gradient tensor with respect to the input of GELU.Type: T
Types:
T: f32, f16, bf16.
Note: Inputs and outputs have the same data type denoted by T. For example, if input is f32 tensor, then all other tensors have f32 data type.