Midjourney is great for creating stills, but you run up against problems when you really need granular controls. So then ComfyUI is what you need, but it’s a much much bigger learn. I guess it’s the equivalent of learning Batch, but with completely different type of tools. However it’s absolutely fascinating to use. One aspect that makes it a good learn, is you are working direct with the AI models, Loras, LLMs, Controlnets. As opposed to the online services where it’s hidden away in a black box. So Comfy UI is great for learning the theory.
The creation of videos is an order of magnitude more complex, at the moment I still use Kling and Higgsfield, cos they do a great job, but they’re essentially toys, they only spit out MP4s that you have to cleanup with Topaz. You can create video in Comfy UI, it’s just not that great yet, and slow as f. But my guess is that will change. We need to be able to create really high quality video in Log or floating point, without the clipped hi lights. That might mean making it the current way and having a second model to repopulate the clipped areas. I dunno.
We also need way more control of whats happening in the video.
The other reason Comfy UI is way better in a professional workflow is the ability to create workflows. I waste so much time uploading and downloading and setting the settings on midjourney, runway, kling, Leonardo, higgsfield, magnific. it’s such an annoying way to work. And all of those involve a subscription.
I want to bring as much off that in to ComfyUI as poss, and have a really slick workflow generating stuff in Comfy and finishing in Flame.
It’s all so interesting.. I’m working with a big (local) brand and google currently to (try, it’s an experiment) create an ad using veo (and lora’s) .. the interesting part is that while they’re ‘ditching’ the agency and production company, they do see the need for post-production/ vfx.. So while veo can do amazing things and google is like: ‘we know what sells, we’ve got that covered’ .. we’re still in the game to polish, fix and manipulate things in post… curious to see where this’ll lead..
Maybe Disney should start creating original stuff again? And not live-action-ish version of things we’ve already seen or part 2,3,4 of something? Maybe AI can come up with something original??? hahahah
Good discussion on the need to pivot as artist and how AI will impact VFX on the CG Garage episode. Start at around minute 46 for that topic. Rest is good too of course.
