What is Activation Function?
A mathematical function in a neural network that decides whether a neuron should pass its signal forward.
Why It Matters
Activation functions allow neural networks to learn complex, non-linear patterns in data.
Real-World Example
The ReLU activation function lets positive values pass through but blocks negative ones.
“Understanding terms like Activation Function matters because it helps you have better conversations with developers and make smarter decisions about your software. You do not need to be technical. You just need to know enough to ask the right questions.”
Related Terms
Neural Network
A computing system inspired by the human brain, made up of layers of connected nodes that learn patterns from data.
Deep Learning
A type of machine learning that uses neural networks with many layers to learn complex patterns.
Backpropagation
The algorithm that calculates how to adjust each part of a neural network to reduce errors.
Learn More at buildDay Melbourne
Want to understand these concepts hands-on? Join our one-day workshop and build a real web application from scratch.
Related Terms
Neural Network
A computing system inspired by the human brain, made up of layers of connected nodes that learn patterns from data.
Deep Learning
A type of machine learning that uses neural networks with many layers to learn complex patterns.
Backpropagation
The algorithm that calculates how to adjust each part of a neural network to reduce errors.
Large Language Model (LLM)
An AI system trained on massive amounts of text that can understand and generate human language.
Transformer
A type of AI architecture that processes text by paying attention to relationships between all words at once, rather...
Attention Mechanism
A technique that lets AI models focus on the most relevant parts of the input when generating output.