For short-term, peer-sourced tests of time, generalizations, specializations, reproductions, etc.!

ICLR 2022 Blog Track About Submitting Tags GitHub project Currently vICLR Spring 2021

© 2022. All rights reserved.

The ICLR Blog Track

Stochastic Autograd

01 Sep 2021 | auto-grad backpropagation tutorial If you know them, let us know
  • Background
    • Manual Calculations
    • Using Programs
  • Automatic Differentiation
    • Chain Rule
    • Forward Accumulation
    • Reverse Accumulation
  • Automatic Differentiation in Practice
    • Jacobians
    • Jacobian Calculation as Computational Graph
    • First-order Optimization Methods
  • Here Comes the Challenger
    • Implementation
    • Questions
  • Akcnowledgments
  • References

Older Newer