An NVIDIA GPU with CUDA support is required for inference. We have tested on a single A100 and H100 GPU. In our experiment, we used CUDA 12.4. Feel free to visit Flux.1-dev for further details on ...