to play 4k 16bit files?, …maybe misunderstood when I say 10k on 25/50gbe nvme NAS, I mean to use it as NAS and Flame Storage,…all in one ,… if that make sense ? that would be an expensive solution… I already have 10GB Synologys in both locations
Looks like you have a specific setup in place / in mind.
Without more detail on your specific workflow and setup, it’s not easy to make meaningful recommendations on what would work or be better.
So best to leave it at answering your question on sync software, which we did, and flag some of the considerations as to performance/workflow consdierations with sync software.
Thanks will do, and if you like, I will report back if it works… probably won’t , …basing my workflow on syncing, is not the best I know…, but repurposing what I already have would be great …if it works.
Thanks Phil, speak soon.
You could also build a project server, pop in a Thunderbolt 4 card, raid all of your NVMe, serve it over 40Gb thunderbolt connections. (way more efficient than buying all of those expensive networking boxes for macs)
This means that you can get away with only caching once, for multiple flames.
So many choices - life is easy these days.
Real shame Synology doesn’t offer a Linux Rocky version of Drive client, as it works so much better than GoodSync on Mac…
Does Cron sync as well as backup?
Looked into resilio…also has conflict issues like GoodSync,…
there is a ubuntu version, …so gonna try a ubuntu VM in Rocky,… (I know…)
and… it works but the performance is a lot slower —surprise, surprise.
I’ve decided to put syncing on hold for now, though I know it works well with Macs. The workflow through NAS and caching on local NVMe drives has been a bit slower than I’d like. It’s a bit cumbersome having to cache things like Nuke.
I keep thinking about the idea of setting up an NVMe-based NAS with a high-speed 50-100GbE network, but I’m not sure if that’s overkill yet. I’ve managed to set up a test workflow thanks to Chris’s write-up, though it’s still in early stages as I don’t have local NVMe automated sync or a backup to NAS RAID. Since I’m working solo, I’m wondering if I even need something like LucidLink. For me, syncing seems more useful than backing up, especially for fast storage. I’ve found that syncing to a NAS and then snapshotting to another NAS works well, which is what I already do. At the end of a project, it means less housekeeping before archiving to LTO, which is the goal for me.
I’ve watched all the videos from Josh and Phil, which are more like walk-throughs than tutorials. They’ve offered a lot of valuable insights, and while they’ve been helpful, I’m still trying to figure out the gotchas. I’d also be happy to pay for a detailed tutorial to fast-track my progress before my next job starts, as I think that could be really valuable.
I’d love to hear what others are doing with their workflows—tips on what to do (and avoid) would be much appreciated. Maybe it’s worth starting a new post for this?
I just want to get a solid understanding of my workflow before diving into automating it with ProjeKT. I want to be sure I know what’s going on before testing it on an actual job.
Need to make a breakout from Stone and Wire ASAP.
Thanks
M
Hey Marios, in your situation, you might get everything you need if you bifurcate your project structure by task. Your synology can just be your ingress, egress and backup portion of the structure. You conform from it, and then publish to a structure on your NVME as exr and work your shots from there. That will give your resulting timelines and shot work realtime playback and your wont be tethered to the synology’s lower bandwidth.
In the background you can sync your NVME storage back to the synology one way so you always have a backup copy of your data.
Let me see if I can’t find some time to make that zoom happen—we can catch up and talk some tech.
Hi Chris,
Thanks for reaching out! Let me know when you have some time—it’d be great to catch up.
I think my setup might be a bit different from most others. For the past 3–4 years, I’ve mainly worked on episodic’s, though I’m still open to and still do commercials. Currently, I mainly work in Flare, using two Flares on subscription (Mac and Rocky), along with a perpetual Flame 2021 on Mac that I use for putting together editorial, references/rollouts, and screen sharing for reviews. The reason for this setup is that I got a great deal when transitioning from a perpetual Flare to a subscription, and I stopped subscribing to Flame after 2021, hence leaving me with a perpetual Flame 2021.
For now, this setup works well for me, and I’m upgrading to Flare 2025 soon. I’ve stuck with this setup unless a client specifically requests Flame 2022 or higher. I also need to add slates to my shots and send QuickTimes for editorial along with EXRs.
As a result, I hardly ever conform. I’ve managed to publish from a timeline in Flare, working from a batch reel, though I’m not sure if there are any limitations with Flare I might not be aware of. One idea I had was to publish from the Flame 2021 timeline from my Mac to/from my NAS, just to get all there paths setup, and then work on the shots in Flare in Linux/Rocky. I wonder if that approach would work, considering the projeKt would only work in 2025. Subscribing to Flame 2025 with 2 Flares (and a perpetual Flame 2021) feels like overkill for me, and a waste of resources, as I work solo most of the time. Yes, you might say I should have just taken the deal on Flame, not Flare, but I had stopped subscriptions on Flame before I got offered the deal.
Maybe I should focus more on a write node workflow and just use timeline publish to set up the paths.
Zoom soon
Thought this was a typo until I discovered https://syncthing.net, looks interesting…
Its great for auto syncing across small studio machines marios . i use GoodSync for uploading to cloud storage/client/producer/ etc
i read a little more of the thread above. i use a VM on a server that pushes my Goodysnc to my clients. i use the mac as just a controller really as its GUI is userfriendly. So my flame has NVME. Syncthing keeps my projects from local storage always backing up to my server at 10gb. So theres one copy of redundancy and them my server with proxmox vm has 2 machines… one that does the Goodsync and another for my file serving. Works well and i have immediate backup, plus i have a cold storage backup also. You could work unmanaged and fast from the NVMe’s as your shot work on flare. The flame could run off your server as it doesnt need to be as fast but always synced. Your server could be the synology or anything really. networked at 1gb, 10gb,. 25gb as much as your budget allows.
Thanks @theoman., do you install syncthing on your linux flame and the NAS your syncing to?
looks like its peer to peer sync so you do,…
Ok found this guide to install it on Synology How to Install Syncthing on Your Synology NAS – Marius Hosting
correct, So i have one on the flame rocky, and one on the server, in my case its running off a Truenas container but can be on any box. I used to then also sync via Syn Drive to my Synology but i bypassed that part of my setup as it was my weakest link.
For Mac with thunderbolt NVMe, just go with Synology Drive Client since it works great out of the box. If you want alternatives, Resilio Sync is good for fast transfers, or rclone if you’re comfortable with command line.
Yes for Mac it seems to be good solution, but I was actually looking a Linux solution and ‘SyncThing’ seems to be the best so far,…