Infinite Photorealistic Worlds using Procedural Generation

Infinigen is developed with the aim of addressing the challenge of data scarcity in computer vision, especially in 3D vision. It leverages procedural generation to create an infinite variety of photorealistic 3D scenes of the natural world, from plants and animals to terrains and natural phenomena. This approach allows for the generation of unlimited, diverse training data for a wide range of computer vision tasks, including object detection, semantic segmentation, optical flow, and 3D reconstruction. The system is entirely procedural, meaning every asset is generated from scratch using randomized mathematical rules, which allows for infinite variation and composition.

Infinigen is unique in its combination of procedural generation, diversity, photorealism, and real geometry. It is also free and open-source, making it a highly accessible tool for computer vision research and beyond. The system is expected to be a valuable resource for the computer vision community, and the developers aim to expand its coverage to virtually everything in the visual world through open-source collaboration.

 

Publication date: June 15, 2023
Project Page: https://infinigen.org/
Paper: https://arxiv.org/pdf/2306.09310.pdf