Diffusion Models And Geometry-Adaptive Harmonic Representations
Deep neural networks trained for image denoising learn true data distribution, not just memorizing training set, due to geometry-adaptive harmonic representations.
This is a Plain English Papers summary of a research paper called Generalization in diffusion models arises from geometry-adaptive harmonic representations. If you like these kinds of analysis, you should subscribe to the AImodels.fyi newsletter or follow me on Twitter. Overview Deep neural networks (DNNs) trained for image denoising can generate high-quality samples using score-based reverse diffusion algorithms. However, recent reports of training set memorization raise questions about whether these networks are truly learning the underlying data distribution. This paper investigat...