shlogg · Early preview
Super Kai (Kazuya Ito) @superkai_kazuya

Heaviside Step Function In PyTorch Explained

Exploring PyTorch's heaviside() and Identity() functions for tensor operations.

Buy Me a Coffee☕
*Memos:

My post explains Step function, Identity and ReLU.
My post explains ReLU() and LeakyReLU().
My post explains PReLU() and ELU().
My post explains SELU() and CELU().
My post explains GELU() and Mish().
My post explains SiLU() and Softplus().
My post explains Tanh() and Softsign().
My post explains Sigmoid() and Softmax().

heaviside() can get the 0D or more D tensor of the zero or more values computed by Heaviside step function from the 0D or more D tensor of zero or more elements as shown below:
*Memos:

heaviside() can be used with torch or a tensor.
The 1st argument...