Last modified: Jun 11 2026 at 12:54 PM • 1 min read

Week 3 - Shallow Neural Networks

This week covers the fundamentals of shallow neural networks, including forward and backward propagation for one hidden layer networks.

---

Table of contents

• Neural Networks Overview
• Neural Network Representation
• Computing a Neural Network's Output
• Vectorizing Across Multiple Examples
• Explanation for Vectorized Implementation
• Activation Functions
• Why Do You Need Non-Linear Activation Functions?
• Derivatives of Activation Functions
• Gradient Descent for Neural Networks
• Random Initialization