Collection of Ivy neural network activations as stateful classes.

class ivy.stateful.activations.GEGLU[source]

Bases: Module


Applies the GEGLU activation function.

class ivy.stateful.activations.GELU(*, approximate=False)[source]

Bases: Module

__init__(*, approximate=False)[source]

Applies the GELU activation function.

This should have hopefully given you an overview of the activations submodule,If you have any questions, please feel free to reach out on our discord in the activations channel or in the activations forum!