Pose2Flux v2.1

August 20, 2024 artificial intelligence

When I launched the v1 of this workflow, the last thing I expected was to see over 125 of you download it and use it. I was joyfully surprised and it made me all the more motivated to pursue this little project. Thanks for this, folks :)


What changed in this v2.1:


  • Switched from SD1.5 to SDXL for the base gen,
  • Switched from Flux.1 dev fp8 to dev NF4 for the refiners,
  • Added Florence2,
  • Added Ollama, 
  • Scraped all 5 detailers I was working on and instead went the noise injection* road. That results in a much leaner and faster workflow, with a way more detailed output at 2K,
  • Added Tiled Diffusion upscaling. In my tests (and settings in the node), 4K works very well. Haven't tried bigger yet,
  • Revamped the color scheme (see Color Codes node),
  • Reworked the Controlnets to offset SDXL's openpose finnickiness. Depth is unofficially driving the entire thing, with segmentation nodes allowing the most finetuning I could find in any of the nodes out there. Right now, the arms are masked along the face, who gets a small opacity treatment so that it only affects proportions and head positioning, nothing else (like hair or expression). It works surprisingly well, albeit with manual tweaks when needed,
  • Added a new switch in the Refiner group to toggle img2img and txt2img (so making this a straight Flux gen workflow) 
  • Various UI refinements.


Get it here ➔ https://zablit.gumroad.com/l/ngjdo