AnyDoor is a new approach to image generation, leveraging diffusion models to “teleport” objects into new scenes at user-defined locations. The model is designed to blend the transferred object harmoniously with its new environment, adjusting for factors like lighting and orientation. AnyDoor is unique in its zero-shot approach, meaning it can handle diverse object-scene combinations without needing specific fine-tuning for each object. The system is capable of both single-object placement and multi-object composition, offering great potential for various real-world applications, such as virtual try-on and object moving.

 

Publication date: 18 Jul 2023
Project Page: Not Provided
Paper: https://arxiv.org/pdf/2307.09481.pdf