Activations

Collection of Ivy neural network activations as stateful classes.

class ivy.stateful.activations.GEGLU[source]

Bases: Module

__init__()[source]

Applies the GEGLU activation function.

class ivy.stateful.activations.GELU[source]

Bases: Module

__init__()[source]

Applies the GELU activation function.