Efficiently Access Diffusion Fisher: Within the Outer Product Span Space

This paper reveals that the diffusion Fisher information in diffusion models can be efficiently approximated using outer products of the score and initial data, rather than relying on computationally intensive auto-differentiation. The proposed algorithms offer improved accuracy and reduced computational cost, with applications demonstrated in likelihood evaluation, optimization, and verifying properties of diffusion maps.