Month 9: Recurrent Neural Networks (RNNs)

Month 9: Recurrent Neural Networks (RNNs)

Week 1: Introduction to RNNs

  • Recap of Neural Networks and Deep Learning Fundamentals
  • Basic RNNs
  • Backpropagation Through Time (BPTT)
  • Vanishing Gradient Problem

Week 2: Long Short-Term Memory (LSTM) Networks

  • Introduction to LSTMs
  • Memory Cells
  • Gates (Input, Output, Forget)
  • Peephole Connections

Week 3: Gated Recurrent Units (GRUs)

  • Introduction to GRUs
  • Simplified Gate Mechanism
  • Architecture of GRUs

Week 4: Applications of RNNs

  • Language Modeling
  • Speech Recognition
  • Music Generation
  • Video Analysis and Captioning