Midjourney is great for creating stills, but you run up against problems when you really need granular controls. So then ComfyUI is what you need, but it’s a much much bigger learn. I guess it’s the equivalent of learning Batch, but with completely different type of tools. However it’s absolutely fascinating to use. One aspect that makes it a good learn, is you are working direct with the AI models, Loras, LLMs, Controlnets. As opposed to the online services where it’s hidden away in a black box. So Comfy UI is great for learning the theory.
The creation of videos is an order of magnitude more complex, at the moment I still use Kling and Higgsfield, cos they do a great job, but they’re essentially toys, they only spit out MP4s that you have to cleanup with Topaz. You can create video in Comfy UI, it’s just not that great yet, and slow as f. But my guess is that will change. We need to be able to create really high quality video in Log or floating point, without the clipped hi lights. That might mean making it the current way and having a second model to repopulate the clipped areas. I dunno.
We also need way more control of whats happening in the video.
The other reason Comfy UI is way better in a professional workflow is the ability to create workflows. I waste so much time uploading and downloading and setting the settings on midjourney, runway, kling, Leonardo, higgsfield, magnific. it’s such an annoying way to work. And all of those involve a subscription.
I want to bring as much off that in to ComfyUI as poss, and have a really slick workflow generating stuff in Comfy and finishing in Flame.
