Browsing by Subject "Non-linear activation function"

Now showing items 1-2 of 2

    • Activation functions in deep neural networks 

      Pretorius, A.M. (North-West University (South Africa), 2020)
      The ability of machine learning algorithms to generalize is arguably their most important aspect as it determines their ability to perform appropriately on unseen data. The impres-sive generalization abilities of deep ...

    • ReLU and sigmoidal activation functions 

      Pretorius, Arnold M.; Barnard, Etienne; Davel, Marelie H. (In Proc. South African Forum for Artificial Intelligence Research (FAIR2019), 2019-12)
      The generalization capabilities of deep neural networks are not well understood, and in particular, the influence of activation functions on generalization has received little theoretical attention. Phenomena such as ...