Users can now create more accurate AI images using 3D layouts via Blender and FLUX.1.
Nvidia has released a new genAI tool that allows developers to generate 2D images based on a pre-built 3D scene. The tool is called ‘Nvidia AI Blueprint for 3D-guided generative AI’ and is available from today, if your PC has an Nvidia RTX 4080 GPU or higher.
From 3D Creation to AI Image
Users build a scene in 3D software Blender with objects such as buildings, cars, or trees. This design is then linked to Black Forest Lab’s FLUX.1 image generator. It uses the 3D scene as a reference to create a detailed 2D image.
Users thus gain more control over the result than if they were working with prompts alone. For example, they can determine from which angle a scene is viewed and what should be placed where, without constantly having to adjust their prompt description to generate a new image.
AI applications
Nvidia describes the tool as an AI blueprint: a predefined, customizable workflow with step-by-step documentation, sample files, and a ready-to-use work environment. With this, the company specifically targets developers building AI applications.
The Verge notes that the idea is not entirely new. Adobe also showcased a similar tool during Adobe MAX 2024, called Project Concept, but it’s not yet available for download.