Jul 19, 2021
PyTorch 1.9 added a native implementation of Mish, my go to activation function for computer vision tasks. In this post I benchmark the computational performance of native Mish on a Tesla V100, Tesla P100, and CPU and compare its speed to other Mish implementations and activation functions.