Beyond automatic differentiation
Posted by Matthew Streeter, Software Engineer, Google Research Derivatives play a central role in optimization and machine learning. By locally approximating a training loss, derivatives guide an optimizer toward lower...