# Copycat node in nuke!

**URL:** <https://forum.logik.tv/t/copycat-node-in-nuke/2785>\
**Category:** Flame Questions\
**Created:** [April 4, 2021, 5:36pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785 "2021-04-04T17:36:28Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![philobedo](https://avatars.discourse-cdn.com/v4/letter/p/b19c9b/32.png) [@philobedo](https://forum.logik.tv/u/philobedo)\
**Post date:** [April 4, 2021, 5:36pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/1 "2021-04-04T17:36:28Z")

</div>

Hi. Just saw quick videos of the copycat node of nuke.  
The principle is amazing!!! I hope Autodesk sec team keeps an eye on that.  
The idea to work on a few frames, give them to the ML node as a training set so it can tale care of the hole sequence is just so great…

---

<div class="post-metadata">

**Author:** ![Skulleyb](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/skulleyb/32/2915_2.png) [@Skulleyb](https://forum.logik.tv/u/Skulleyb)\
**Post date:** [April 4, 2021, 7:56pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/2 "2021-04-04T19:56:01Z")

</div>

It has potential but the training times fir a roto and fixes to the model of the tutorial videos I watch are crazy. 5 hours to train a roto then hope it works… great Start but not really practical as of yet

---

<div class="post-metadata">

**Author:** ![philobedo](https://avatars.discourse-cdn.com/v4/letter/p/b19c9b/32.png) [@philobedo](https://forum.logik.tv/u/philobedo)\
**Post date:** [April 4, 2021, 9:33pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/3 "2021-04-04T21:33:07Z")

</div>

Yes sure.  
I just think about the ability to train your own model on your own shot…

You clean 5 frames before you leave beauty or object removal for example) , let the ML train all icky and give it a try next morning.if it works great, you win. If not, no time most you just do it the regular way…

Would love to play with that. 😉

---

<div class="post-metadata">

**Author:** ![AdamArcher](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/adamarcher/32/3529_2.png) [@AdamArcher](https://forum.logik.tv/u/AdamArcher)\
**Post date:** [April 4, 2021, 10:01pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/4 "2021-04-04T22:01:16Z")

</div>

What would be groundbreaking is if there was some kind of AI/ML based database existed in the cloud so that everyone’s efforts were pooled in a way that everyone could benefit. ML results improve the more times they are run.

If each ML attempt had a tag, say rotoscoping, depth matte, speed, pimple removal, etc; it could get crazy good within a couple of years.

---

<div class="post-metadata">

**Author:** ![philobedo](https://avatars.discourse-cdn.com/v4/letter/p/b19c9b/32.png) [@philobedo](https://forum.logik.tv/u/philobedo)\
**Post date:** [April 4, 2021, 10:05pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/5 "2021-04-04T22:05:13Z")

</div>

Agreed… would be so nice. Would also be a great way to allow people who don’t know ML thing in depth to add their stone anyway. (My case obviously)

---

<div class="post-metadata">

**Author:** ![andymilkis](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andymilkis/32/11067_2.png) [@andymilkis](https://forum.logik.tv/u/andymilkis)\
**Post date:** [April 5, 2021, 2:33am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/6 "2021-04-05T02:33:21Z")

</div>

I’ve been obsessing over this for the last couple of weeks. The thing is AMAZING if you understand the limitations and potential.

@Skulleyb let me reframe it for you. I just did some roto with it last week. I’m working on a promo with 4 diff talent. I took one shot of each person: 4K shots, 130 frames each. I made 4 super precise roto frames per clip and let CopyCat do the rest. Took me about 30 mins to do the 4 frames, and the training was 4 hours. I have 2 machines and so I could do two at the same time. Results were shockingly good. The best part is that I have 5 more shots of each person, and I can use the trained models on the other shots for them. I might need to roto a couple more key frames but it’s worth a shot.

Now…ask me about the beauty work 😀

---

<div class="post-metadata">

**Author:** ![Jeff](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/jeff/32/9305_2.png) [@Jeff](https://forum.logik.tv/u/Jeff)\
**Post date:** [April 5, 2021, 4:20am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/7 "2021-04-05T04:20:02Z")

</div>

I’ve seen these mattes up close and personal from Andy I can confirm they are indeed SHOCKINGLY good. It’s a really cool use-case we have here for the project we’re working on, but obviously it wouldn’t be the best route for every project. Perfect for an overnight render and you wake up in the morning and if it’s good, you’ve saved several hours, if it’s bad you’ve wasted 30 minutes.

---

<div class="post-metadata">

**Author:** ![finnjaeger](https://avatars.discourse-cdn.com/v4/letter/f/e99b99/32.png) [@finnjaeger](https://forum.logik.tv/u/finnjaeger)\
**Post date:** [April 5, 2021, 2:14pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/8 "2021-04-05T14:14:20Z")

</div>

I used it for matchgrading some replacement shots and it saved me from dragging them through grading again.

-Input old ungraded shot  
-Groundtruth Old graded shot

I just frameheld like 10 frames and let it train, result was pretty much spot on, got some minor artifacts in some places but for a tvc it would be enough. pretty cool.

---

<div class="post-metadata">

**Author:** ![Jeff](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/jeff/32/9305_2.png) [@Jeff](https://forum.logik.tv/u/Jeff)\
**Post date:** [April 5, 2021, 4:03pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/9 "2021-04-05T16:03:22Z")

</div>

That’s another really cool application! Great idea!

---

<div class="post-metadata">

**Author:** ![space\_monkey](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/space_monkey/32/49_2.png) [@space\_monkey](https://forum.logik.tv/u/space_monkey)\
**Post date:** [April 6, 2021, 6:04pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/10 "2021-04-06T18:04:42Z")

</div>

I think I made a suggestion for this to the flame improvement and so far only two votes, FI-02518

---

<div class="post-metadata">

**Author:** ![ALan](https://avatars.discourse-cdn.com/v4/letter/a/a87d85/32.png) [@ALan](https://forum.logik.tv/u/ALan)\
**Post date:** [April 6, 2021, 6:20pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/11 "2021-04-06T18:20:01Z")

</div>

Good luck… we are still trying to get MotionVector Tracking in flame that doesn’t crash the machine or constantly require re-calculation, years after its release.

---

<div class="post-metadata">

**Author:** ![andymilkis](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andymilkis/32/11067_2.png) [@andymilkis](https://forum.logik.tv/u/andymilkis)\
**Post date:** [April 7, 2021, 1:22am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/12 "2021-04-07T01:22:24Z")

</div>

I just added a vote to this.

---

<div class="post-metadata">

**Author:** ![space\_monkey](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/space_monkey/32/49_2.png) [@space\_monkey](https://forum.logik.tv/u/space_monkey)\
**Post date:** [April 7, 2021, 2:03am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/13 "2021-04-07T02:03:53Z")

</div>

thank you! You are a legend!

---

<div class="post-metadata">

**Author:** ![philm](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/philm/32/9286_2.png) [@philm](https://forum.logik.tv/u/philm)\
**Post date:** [April 7, 2021, 6:17am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/14 "2021-04-07T06:17:38Z")

</div>

The flame improvements/beta improvements tools could do with some improvements…

It’s kind of weird that you can’t just see the whole list at one time, what has votes, what doesn’t have votes, what has cobwebs, (what has a pulse)…

I mean, what differentiates a feature request from an improvement and when is it appropriate to request an improvement for a release version (which by definition is too late) or an improvement for a beta which may or may not see the light of day?

Its weird.

I’ve yet to understand it.

---

<div class="post-metadata">

**Author:** ![space\_monkey](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/space_monkey/32/49_2.png) [@space\_monkey](https://forum.logik.tv/u/space_monkey)\
**Post date:** [April 7, 2021, 5:41pm UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/15 "2021-04-07T17:41:50Z")

</div>

I don’t disagree with you, but I just do what I can to try and contribute and help what seems like a small team over at ADSK see what troubles we have and tools we want , I am not sure of a better option but I bet if you talk with them they always seem receptive to suggestions.

---

<div class="post-metadata">

**Author:** ![Brooks](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@Brooks](https://forum.logik.tv/u/Brooks)\
**Post date:** [April 8, 2021, 12:41am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/16 "2021-04-08T00:41:30Z")

</div>

@andymilkis#8930 or anyone else. Do you have to use nukes roto tool for copy cat? Or could you just supply a matte? Photoshops smart object detection is really good. So you could make your training frames, using another programs machine learning. 🙂

---

<div class="post-metadata">

**Author:** ![andymilkis](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andymilkis/32/11067_2.png) [@andymilkis](https://forum.logik.tv/u/andymilkis)\
**Post date:** [April 8, 2021, 12:52am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/17 "2021-04-08T00:52:40Z")

</div>

You can just supply it a matte.

---

<div class="post-metadata">

**Author:** ![miles](https://avatars.discourse-cdn.com/v4/letter/m/47e85d/32.png) [@miles](https://forum.logik.tv/u/miles)\
**Post date:** [April 8, 2021, 1:23am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/18 "2021-04-08T01:23:36Z")

</div>

Probably a not nice thing to say, but at Asylum we had a full on Roto Dept. I remember when production started outsourcing. I was so pissed I told them we should outsource Production… But I have to say the costs are reasonable and there’s no babysitting. For roto I’m send it and forget it. Until my un-outsourced producer tells me it’s ready. Rarely do I have to send any back. Besides ML is kinda like outsourcing everything to a XPU… I need to keep working for another decade at least.

---

<div class="post-metadata">

**Author:** ![Francesco.Bianco](https://avatars.discourse-cdn.com/v4/letter/f/ecae2f/32.png) [@Francesco.Bianco](https://forum.logik.tv/u/Francesco.Bianco)\
**Post date:** [April 8, 2021, 8:59am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/19 "2021-04-08T08:59:04Z")

</div>

hi @andymilkis, did you have to work within nuke or did you find a way do it partially in flame. Do you think that through a pybox node in flame would be possible to do at least part of the job (roto or just final result).

---

<div class="post-metadata">

**Author:** ![andymilkis](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andymilkis/32/11067_2.png) [@andymilkis](https://forum.logik.tv/u/andymilkis)\
**Post date:** [April 8, 2021, 9:20am UTC](https://forum.logik.tv/t/copycat-node-in-nuke/2785/20 "2021-04-08T09:20:27Z")

</div>

For the training I think you’re gonna want to work in Nuke. Once you have the model trained it should be pretty straightforward to set up a pybox to feed it your shot and get the result frames back. It’s def on my list to try soon!

[Next page](https://forum.logik.tv/t/copycat-node-in-nuke/2785.md?page=2)
