Overview

Background
Design
Related Work
Extensions
Contributing
Deep Dive
FAQ
Glossary

Functions

Experimental
Activations
Constants
Control flow ops
Creation
Data type
Device
Elementwise
Experimental
General
Gradients
Layers
Linear algebra
Losses
Manipulation
Meta
Nest
Norms
Random
Searching
Set
Sorting
Statistical
Utility

Data Classes

Container
Array

Framework Classes

Optimizers
Activations
- GELU
- GEGLU
Layers
Module
Initializers
Converters
Sequential
Helpers
Norms

Nested array

Nested array

Docs

Ivy
Ivy mech
Ivy vision
Ivy robot
Ivy gym
Ivy memory
Ivy builder
Ivy models
Ivy ecosystem

Ivy

»
Activations »
GEGLU
View page source

GEGLU

class ivy.stateful.activations.GEGLU[source]

Bases: Module

__init__()[source]: Applies the GEGLU activation function.

Supported Frameworks:

Previous Next

© Copyright 2020-2023, Ivy Team.

Built with Sphinx using a theme provided by Read the Docs.