GELU
Beginner NVIDIA, Meta+3
Master the GELU activation function: f(x) = x * Φ(x). Smooth approximation, standard in transformers. Implement forward and backward passes. Understand when to use it.
Keywords
deep-learningactivations
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.