Apple Sharp 3D

Flame Tools and Tech
,
1

Apple Sharp 3D Photo Tutorial (1 image to Gaussian Splatting)

5 Likes
2

This is the sort of toolset I’ve been wanting to see within Flane for a while. Whether based on Gaussian Splats, Nerf or whatever. So many incredible use cases (clean non-generative AI background creation allowing for parallax anyone?).

but anyway…

6 Likes
3

how about that new Text node though….

5 Likes
4

I love this year’s new toys from Autodesk. Now it compliments my new pair of undies I got for Christmas.

1 Like
5

How are you using this in production? How do you tweak or cleanup the ply files?

6

I guess for now the answer is ‘in nuke’

1 Like
7

You mean like this? With this OFX: https://aescripts.com/gaussian-splatting-for-davinci-resolve/

8 Likes
8

Hi Ton,

Thanks for sharing this, this OFX seems to be developed for DaveVinci or Nuke, is it the one used in this video ? How can it be compatible with flame ?

Thx

9

Fwiw some ofx will just work by default, others not so much

2 Likes
10

Hey Ton,

thanks for sharing. Does it give you a point cloud as well as any cleanup tools?

I think something like this with a camera track alignment tool (so you could quickly line up a Gaussian splat with an actual camera plate) then that would be cool.

I’ll investigate but I’d also like the ability to feed in multiple plate shots to create the Gaussian splat within Flame. I am very much thinking of this along the lines of a 3D parallax cleanup tool. Would also come in handy for stitching plates together when cameras are doing different moves between plates. Lots of practical use cases, that’s for sure.

11

Maybe you can use SuperSplat Editor for editing the files.

12

There’s a few tools to edit them outside. That is still the go for sure. My point was more that it would be nice to do them within the compositing tool but as others have said previously, Flame could do with a refresh of the 3D environment interface prior to implementing something like this. In the end, there are so many dev requests for Flame that I don’t think this would be a high priority, even if Foundry have just introduced it for Nuke after doing a full work over of their 3D environment.

13

Has Gaussian Splat won out over NERFs? If so… it does seem like this would be a tool that could fit into the Action environment.

1 Like
14

Not necessarily. They both have their place. There is new approaches still being explored with even better results again. It is hard to keep up with all the tech advances happening.

1 Like
15

There are actual hybrid models like Splatfacto that utilise both Nerf & Gaussian splatting that can even allow relighting. Haven’t played with this yet but relighting will be huge.

16