This paper introduces Artistic Cinemagraph, a fully automated method for creating cinemagraphs from text descriptions. The method is especially effective when prompts feature imaginary elements and artistic styles, given the complexity of interpreting the semantics and motions of these images. The proposed method synthesizes image twins from a single text prompt, a pair of an artistic image and its pixel-aligned corresponding natural-looking twin. The predicted motion can then be transferred to the artistic image to create the final cinemagraph. This method outperforms existing approaches in creating cinemagraphs for natural landscapes as well as artistic and other-worldly scenes.
Publication date: Jul 6, 2023
Project Page: N/A
Paper: https://arxiv.org/pdf/2307.03190.pdf
