
Tarique Hussain
Articles
-
Sep 27, 2023 |
mdpi.com | Tarique Hussain |Zulfiqar Memon |Rizwan A. Qureshi |Tanvir Alam
6.1. DiscussionOur study emphasizes the significance of normalization layers and activation functions in deep learning networks for stable optimization and enhanced generalization. We discuss the innovative EvoNorm layer, which outperforms the traditional Batch Normalization and Rectified Linear Unit (ReLU) combination. Two EvoNorm variants, EvoNorm-B and EvoNorm-S, are presented, with the latter incorporating the Swish activation function.
Try JournoFinder For Free
Search and contact over 1M+ journalist profiles, browse 100M+ articles, and unlock powerful PR tools.
Start Your 7-Day Free Trial →