# Machine learning for relighting?

**URL:** <https://forum.logik.tv/t/machine-learning-for-relighting/1874>\
**Category:** Flame Questions\
**Tags:** machine-learning\
**Created:** [December 17, 2020, 1:54pm UTC](https://forum.logik.tv/t/machine-learning-for-relighting/1874 "2020-12-17T13:54:54Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![dinotsaousis](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/dinotsaousis/32/180_2.png) [@dinotsaousis](https://forum.logik.tv/u/dinotsaousis)\
**Post date:** [December 17, 2020, 1:54pm UTC](https://forum.logik.tv/t/machine-learning-for-relighting/1874/1 "2020-12-17T13:54:54Z")

</div>

I’m about to “light” some candles in a scene and there are various objects and people in the scene in relatively close proximity to the candles I was wodnering if theres any way (or tutorial) to use machine learning to relight the objects/subjects? Or if anyone has any general tips or tricks for flickering candle light relight.

---

<div class="post-metadata">

**Author:** ![TimC](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/timc/32/11881_2.png) [@TimC](https://forum.logik.tv/u/TimC)\
**Post date:** [December 17, 2020, 2:16pm UTC](https://forum.logik.tv/t/machine-learning-for-relighting/1874/2 "2020-12-17T14:16:54Z")

</div>

hey Dino!

There are no ML tools in flame (as of yet) for a task like this. Altho there is quite a lot of ML happening with VFX out there, it’s all custom build and quite time consuming to create models in order to define the task at hand. Unless you have a lot of time and a really robust GFX card (or two!)…

that being said i think you could use some of the face and body ML extract tools to help build custom CC maps to simulate soft illumination color correct on people and the rest is roto to isolate objects; surfaces to all get illuminated. You can combine your roto shapes with shadow casting in Action. I also have had a lot of success using sapphire rays set to black or negative to simulate the negative space from shadows in illumination.

let me know if that makes sense! cheers

---

<div class="post-metadata">

**Author:** ![greg](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/greg/32/1185_2.png) [@greg](https://forum.logik.tv/u/greg)\
**Post date:** [December 17, 2020, 3:03pm UTC](https://forum.logik.tv/t/machine-learning-for-relighting/1874/3 "2020-12-17T15:03:22Z")

</div>

You can check out this series on ML face normal and depth extraction, which, in theory, is what you’re asking about. Not sure if the results will give the quality you want. I would say that this is more useful for a subtle brightening or shaping, not a photoreal effect like you’re describing.

[![](https://us1.discourse-cdn.com/flex020/uploads/thedepartmentofexternalservices/original/1X/98ace3cbd4331ef9871e23b2a9478634e9e29dde.jpeg "Machine Learning - Part 3 - Human Face 3D Relighting - Flame 2020") ](https://www.youtube.com/watch?v=ymDI2CxXPEs)

---

<div class="post-metadata">

**Author:** ![andymilkis](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andymilkis/32/11067_2.png) [@andymilkis](https://forum.logik.tv/u/andymilkis)\
**Post date:** [December 18, 2020, 11:54am UTC](https://forum.logik.tv/t/machine-learning-for-relighting/1874/5 "2020-12-18T11:54:24Z")

</div>

I’m having major late-90s Showtime promo flashbacks where we used S\_GlowDarks ❤🔥🕶

---

<div class="post-metadata">

**Author:** ![TimC](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/timc/32/11881_2.png) [@TimC](https://forum.logik.tv/u/TimC)\
**Post date:** [December 18, 2020, 1:11pm UTC](https://forum.logik.tv/t/machine-learning-for-relighting/1874/6 "2020-12-18T13:11:02Z")

</div>

SOME TRICKS NEVER DIE 🤣 @andymilkis

---

<div class="post-metadata">

**Author:** ![PlaceYourBetts](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/placeyourbetts/32/6852_2.png) [@PlaceYourBetts](https://forum.logik.tv/u/PlaceYourBetts)\
**Post date:** [February 28, 2024, 2:38am UTC](https://forum.logik.tv/t/machine-learning-for-relighting/1874/7 "2024-02-28T02:38:44Z")

</div>

> **[Beeble - AI Lighting for Filmmakers](https://www.beeble.ai/)**
>
> Extract 3D Geometry and PBR maps from video for integration with any 3D software. New era of storytelling with precise lighting and parallax, all in post-production.
