Lightweight 'steering damper' for prompt alignment
Diffusion Controller is a lightweight 'steering damper' network that improves prompt alignment in diffusion-based image generation. It attaches seamlessly to access-restricted or closed-source models without destabilizing baseline behavior.
Supporting evidence
How Diffusion Controller unifies and simplifies AI image generation
Original excerpt
We introduce Diffusion Controller, a lightweight "steering damper" network that precisely steers image generation to achieve significantly better prompt alignment. It seamlessly attaches to even access-restricted, closed-source models, boosting image quality without breaking baseline stability.