SoftPlusBackprop
SoftPlusBackprop#
Versioned name: SoftPlusBackprop-1
Category: Activation
Short description: SoftPlusBackprop computes gradient for SoftPlus
Attributes:
beta
Description: beta is value for the Softplus formulation.
Range of values: a s64 value
Type: s64
Default value: 1
Required: no
Inputs:
1:
input_forward
- original input tensor of SoftPlus op. Required.Type: T
2:
output_delta
- the gradient tensor with respect to the output. Required.Type: T
Outputs
1:
input_delta
- the gradient tensor with respect to the input of SoftPlus.Type: T
Types:
T: f32, f16, bf16.
Note: Inputs and outputs have the same data type denoted by T. For example, if input is f32 tensor, then all other tensors have f32 data type.