Open Access

ABSTRACT

New Activation Functions in CNN and Its Applications

Tomoyuki Enomoto, Kazuhiko Kakuda, Shinichiro Miura

Nihon University, Narashino, Chiba 275-8575, Japan.
* Corresponding Author: Tomoyuki Enomoto. Email: cito18002@g.nihon-u.ac.jp.

The International Conference on Computational & Experimental Engineering and Sciences 2019, 21(2), 36-39. https://doi.org/10.32604/icces.2019.05292

Abstract

In this paper, the nonlinear activation functions based on fluid dynamics are presented. We propose two types of activation functions by applying the so-called parametric softsign to the negative region. We apply the activation function to CNN (Convolutional Neural Network) which performs image recognition and approaches from multiple benchmark datasets such as MNIST, CIFAR-10. Numerical results demonstrate the workability and the validity of the present approach through comparison with other numerical performances.

---

Keywords

---