Flame - Suggestions as to how it could embrace AI

I still use the furnace, great set of tools.

What I really want is a machine learning powered smart spill suppress. I don’t think I’ve seen this anywhere, but I’d love it as a tool. Feed a plate and BG in there and be able to adjust for skin tones, bounced light, retain clothing and object colors that are similar to screen color in a more natural way, etc etc.

Been playing with this. It’s pretty amazing. Still haven’t tried yet to get the PBR maps working in Flame.

2 Likes

Watch this…ChronoDepth: Learning Temporally Consistent Video Depth from Video Diffusion Priors

I’ve been playing with this and its quite good, I think this is the most stable depth map estimation tool I’ve tried. DepthAnything is good but its not as temporal consistent as this.

I find it needs quite a lot of vram (24g+) to work properly with 100+ frames plates but its quite quite stable, also, you can define how stable it should be by defining the number of frames (which is not the frames of the plate but the how many frames it will be consistent)

Also, It can export frame sequence instead of mp4 video if you need to, just need to enable that in the code

1 Like

I’m using Photoshop for a lot of automatic matte painting. I have a batch setup saved that exports a still and imports the PSD result. Saved many hours already from manually painting.

2 Likes

Looks cool. Kinda feels like this was the promise with the first generation of ML tools introduced in Flame, but feels like they never got around to make it work.

1 Like