Flame Machine Learning Timewarp, now on Linux and Mac

Hey!

Thanks guys! I managed to get it working again also. :slight_smile: Didn’t need to edit the init_env script.

Did a clean install of the latest version… then…

Ran this:

/bin/bash --rcfile <(echo ‘. ~/.bashrc; eval “$(~/flameTimewarpML/miniconda3/bin/conda shell.bash hook)”; conda activate’)

and then this:

pip install torch==1.9.0+cu111 torchvision==0.10.0+cu111 torchaudio==0.9.0 -f https://download.pytorch.org/whl/torch_stable.html

Happy!!

thanks @talosh and @cnoellert

1 Like

Thank you @talosh and @cnoellert for this! It’s soooo good.
Is it working with Linear/ACEScg in the latest version?
Our current workaround is to flip it to Arri Alexa logC - do the TW and flip back to ACEScg

It’s all @talosh

1 Like

Hi ive just installed this and WOW its done an amazing job.

My only issue is it has shifted the colour drastically?

Its a ACEScg shot but i changed it to rec709 before the TW

It doesn’t change the color it just might change the tagged color space when it auto imports back in so check that and you should be fine.

CPU only on Mac. My Mac Pro was 35-50 secs/frame. Linux with a RTX 6000 is 2-3 frames per second.

…beta? Thought M1 wasn’t supported.

Hi William,
TimewarpML does use “Pytorch" library (https://pytorch.org) to process images using neural networks.
It is technically opensource but mostly driven from Facebook. At the moment unfortunately there are no M1 Nueral Engine backend implemented.
But we have a quote from this thread (https://github.com/pytorch/pytorch/issues/47702):

We plan to get the M1 GPU supported. @albanD, @ezyang and a few core-devs have been looking into it. I can’t confirm/deny the involvement of any other folks right now.

Apparently there is a way to install native arm-compiled version (with 1.9.0) and it might be faster then the emulated one.
I don’t have any M1 machines around to really test it but there are some info that google gives us:

https://towardsdatascience.com/yes-you-can-run-pytorch-natively-on-m1-macbooks-and-heres-how-35d2eaa07a83

https://betterprogramming.pub/how-to-install-pytorch-on-apple-m1-series-512b3ad9bc6

So, there’s a hope that one day M1 will come on board in full glory.

1 Like

great thanks for whatever reason I thought PyTorch was native m1 supported and was just curious, but thanks for following up and will be interested to see how it goes.

@talosh, First: Fantastic work, its does some great work.

I do have some questions, when I run the script on there is some questions.
It always defaults to a certain path to do it’s work. Can that be modified in the menu?
Whenever I run it, its locked to the path. What defines that path? I was trying to figure
out in the script, where it’s being defined.

The other question is, sometimes the files seem to render, but it doesn’t populate in reel.
I have found the files, I was reading through board, I think there was something that addresses that.

Thanks in advance

Hi Brian,
This is not an expected behaviour and suggests some issues with the script reading or writing its preferences.
The first thing to check is probably if there’s enough permissions to read and write things.

Not sure what platform are you on but on linux prefs should be in ~/.config folder and on mac it is ~/Library/Preferences
I think in the current version the lock files that are responsible for getting thing imported back are placed there as well
(that was something I’d like to change in new one but it is still IP).

So could you please check if there’s anything related to TimewarpML in this folder and if it is generally readable / writable?

Regards,
Andriy.

whats the preffered colorspace to send to ml-timewarp?

-its rendering back exrs even if the source data is not float

it errors on the publish when i try to push linear into it

most ml tools preffer 709 because of the training data i guess.

so imho if its 709 it should write dpx and not exr ?

I’ll be honest @finnjaeger
This thread has gotten a little too big for me to manage.

I am still stuck on Flame 2020 so when I finally get python 3 I and going to have more than 330 messages to wade through.

@talosh i can’t thank you enough for the work you have done. I hope you will forgive me if I dm you in a couple of months, when I finally update, to pick your brain.

Once again. Thank you but is there anyway you can slow the flow of questions to this thread @randy? I will need to get up to speed at some point.

1 Like

Hmm. It’s a big thread, yes. But I’m not sure how slowing anything would be helpful. There really isn’t that much you need to read. The information is here if and when you need it. All you gotta do is find the latest download on the GitHub, install it, and off you go. A vast majority of the posts in this thread are older questions about Mac and cpu only and relevant only to older versions of the tool. And when some of us had installation problems we posted here, but, those are unlikely to happen to you. I’m super proud that there’s a single place on the entirety of the internet where sysadmins and artists can go to find out about it. If in 1,000 years digital archaeologists were going through the rubble of the internet they’d likely look at this thread and nod approvingly. The search is your friend. The thread is a year old but activity has slowed substantially so when the late adopters join the party they can wade through the empty champagne bottles and Polaroid selfies to see what they’ve been missing. :slight_smile:

6 Likes

Andy,
Question? Is there a way you can replace this link or add a solution to the one, that points to the release page on GitHub?

That way, when people search in the future, (like I did) they can just click right to the latest and greatest! This tool is way to cool to not have everyone using it!

2 Likes

Hi Finn,

I’ve found it pretty robust with any colour space so seems it is not that dependant on it.
Though it is always good to try things out.

According to the exrs it currently works by exporting exrs and importing exrs back regardless of the input clip. If it is something you’d like to change please let me know.
I found no way as yet to get clip’s tagged colourspace in python, so there’s no way for me to tag it back. If someone knows it is possible please point me to the right direction in the API )

Hope that helps,
Andriy.

Done!

1 Like

If you are using an RTX 5000, RTX 6000 or RTX 8000, which is a CUDA series from Nvidia, then you can ignore this.

To consolidate and organize the information for for those of you on Centos 8.2 using Ampere GPUs such as the RTX A4000, RTXA5000 and/or RTX A6000, these are the instructions to get TWML up and running.

This is after a fresh install of the Adsk Centos 8.2 kickstart and after a fresh install of Flame and the 0.4.3 TWML, you’ll get an error message when attempting to launch the tool after installation in Flame.

Centos 8.2 doesn’t include Konsole…so…

yum install https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm

yum install konsole -y

cd into the flametimewarp which for me is…

cd /home/randy/flametimewarpml/bundle

or,

cd /home/<insertuserhere>/flametimewarpml/bundle

./init_env

in the new Konsole window that pops up…

pip install torch==1.9.0+cu111 torchvision==0.10.0+cu111 torchaudio==0.9.0 -f https://download.pytorch.org/whl/torch_stable.html

Boom. Fran’s your nan.

3 Likes

One thing that is interesting @talosh about this Centos 8.2 / torch 1.9.0 on Flame 2022.1 is that after export the Flame export menu doesn’t ‘release,’ effectively keeping the TWML process as a ‘foreground’ process.

Any thoughts?

Hi Randy,
I was actually running it on Centos8.2 and 2022.1 and have not seen this issue (The graphics card is from Maxwell generation though)

The only thing I’ve noticed is that Flame comes in front of the termnal window and one has to switch manually.

So, it is difficult to say what would be the cause for that but looking at info from flame terminal window might be helpful here.

We’ve just got upgraded to 2022.2 so I’ll have a chance to check it there.

1 Like