# Runway ML with amazing roto!

**URL:** <https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330>\
**Category:** Tools and Tech\
**Created:** [February 5, 2021, 7:11pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330 "2021-02-05T19:11:48Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ben](https://avatars.discourse-cdn.com/v4/letter/b/df788c/32.png) [@Ben](https://forum.logik.tv/u/Ben)\
**Post date:** [February 5, 2021, 7:11pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/1 "2021-02-05T19:11:48Z")

</div>

[![](https://us1.discourse-cdn.com/flex020/uploads/thedepartmentofexternalservices/original/2X/d/d1002fde98144f31b6bfbd3e5ca89f14ae7a1a2c.jpeg "Real-Time VFX Demo | Rotoscoping 3 Shots in 10 Minutes Using Machine Learning") ](https://www.youtube.com/watch?v=Jo9a73fECXY)

Thos looks very interesting for quick and easy rotos.

---

<div class="post-metadata">

**Author:** ![PlaceYourBetts](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/placeyourbetts/32/6852_2.png) [@PlaceYourBetts](https://forum.logik.tv/u/PlaceYourBetts)\
**Post date:** [February 5, 2021, 7:26pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/2 "2021-02-05T19:26:47Z")

</div>

Fascinating to see automatic roto getting better and better.

> **[Green Screen | Runway](https://runwayml.com/green-screen/)**
>
> Remove the background from a video automatically with one click.

---

<div class="post-metadata">

**Author:** ![Jeff](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/jeff/32/9305_2.png) [@Jeff](https://forum.logik.tv/u/Jeff)\
**Post date:** [February 5, 2021, 7:32pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/3 "2021-02-05T19:32:22Z")

</div>

I’m blown away by how awesome it looks, but also by how amazing that interface is. For such groundbreaking technology, I’m so impressed that it looks so nice and easy to use. Reminds me of [Frame.io](http://Frame.io)!

---

<div class="post-metadata">

**Author:** ![AndyBrown](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andybrown/32/708_2.png) [@AndyBrown](https://forum.logik.tv/u/AndyBrown)\
**Post date:** [February 6, 2021, 4:50am UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/4 "2021-02-06T04:50:54Z")

</div>

This looks great. Sent off about 20 shots for roto this week, so I’ll give this a go and see how they compare.

---

<div class="post-metadata">

**Author:** ![greg](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/greg/32/1185_2.png) [@greg](https://forum.logik.tv/u/greg)\
**Post date:** [February 6, 2021, 6:18am UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/5 "2021-02-06T06:18:35Z")

</div>

It’s a nice idea but I just tried it with something that would be simple for a human to do (a building against a blue sky - undistorted and denoised) and the results I’m getting are not usable. Oh well…

There’s a bunch of other ML tools on that site that seem intriguing, though. And there’s something in there about using it to create your own ML tools within their system, so there’s definitely a lot of potential there.

---

<div class="post-metadata">

**Author:** ![AndyBrown](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andybrown/32/708_2.png) [@AndyBrown](https://forum.logik.tv/u/AndyBrown)\
**Post date:** [February 6, 2021, 7:15am UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/6 "2021-02-06T07:15:40Z")

</div>

I wonder whether it is trained to recognize humans and that’s why buildings don’t work?

---

<div class="post-metadata">

**Author:** ![greg](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/greg/32/1185_2.png) [@greg](https://forum.logik.tv/u/greg)\
**Post date:** [February 6, 2021, 1:49pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/7 "2021-02-06T13:49:27Z")

</div>

Well, I expected that to the the case but there’s nothing saying that it’s only for people - it just says pick the object to extract. And it does a good job selecting the object in a single frame - its just that once it process the video, the edges jump from frame to frame and smaller features pop on and off.

---

<div class="post-metadata">

**Author:** ![Ben](https://avatars.discourse-cdn.com/v4/letter/b/df788c/32.png) [@Ben](https://forum.logik.tv/u/Ben)\
**Post date:** [February 6, 2021, 2:52pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/8 "2021-02-06T14:52:59Z")

</div>

Yeah its still early days but i imagine over the next few years it could become a very useful and timesaving tool. Obviously there are issues around how the shots are uploaded and stored? Makes it a non starter for alot of professionals but hopefully that will change.

---

<div class="post-metadata">

**Author:** ![andymilkis](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/andymilkis/32/11067_2.png) [@andymilkis](https://forum.logik.tv/u/andymilkis)\
**Post date:** [February 6, 2021, 11:43pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/9 "2021-02-06T23:43:31Z")

</div>

Trying to get these guys on an upcoming Logik Live. Stay tuned!

---

<div class="post-metadata">

**Author:** ![MikeyBrown](https://avatars.discourse-cdn.com/v4/letter/m/ec9cab/32.png) [@MikeyBrown](https://forum.logik.tv/u/MikeyBrown)\
**Post date:** [February 7, 2021, 8:13am UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/10 "2021-02-07T08:13:09Z")

</div>

Amazing!

---

<div class="post-metadata">

**Author:** ![zorrofx](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/zorrofx/32/949_2.png) [@zorrofx](https://forum.logik.tv/u/zorrofx)\
**Post date:** [February 10, 2021, 3:49pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/11 "2021-02-10T15:49:05Z")

</div>

Yes, this has a lot of potential. I tried a version of Rotobot in Flame and it was useless and super slow.  
It definitely looks like it’s done most of it’s learning with human figures and that’s probably good because people wiggle around a lot.  
I think what RunwayML is missing is refining controls such as denoising to reduce the chatter between frames, and feathering of some sort for the motion blurry parts. I guess machines still have a lot to learn (pun intended) but still, very impressive and helpful in certain scenarios

---

<div class="post-metadata">

**Author:** ![ChrisKasten](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.logik.tv/chriskasten/32/150_2.png) [@ChrisKasten](https://forum.logik.tv/u/ChrisKasten)\
**Post date:** [April 21, 2021, 1:03pm UTC](https://forum.logik.tv/t/runway-ml-with-amazing-roto/2330/12 "2021-04-21T13:03:42Z")

</div>

Just tested out Green Screen on a 150 frames shot of a dude dancing in a dark blue shirt in front of a dark blue curtain and there’s a quite opaque haze overall.  
Well… yes… mindblown… Not 100% but as a starting point it saves me hours of roto!

One question remains: In the fabulous logik event they talked about an offline tool of green screen. I’ve the creators subscription but can’t find anything download tool related… Am I missing something?
