Derivatives, Backpropagation, and Vectorization.pdf

Derivatives:Scalar Case;Gradient: Vector in, scalar out;Jacobian: Vector in, Vector out;Generalized Jacobian: Tensor in, Tensor out. Backpropagation with Tensors.