Generating video from a picture using a specifical prompt with AI?

Hi

I have a picture (some umbrellas in a sunny beach) and I’d like generate a video in a specifical way, simulating a strong wind or a hurricane is affecting the umbrellas. All AI’s I have found only make pans or camera movements. I’d need an specifical prompt to give it specifical input.

Does anyone know some Ai that work like this?

Have you tried runway? https://runwayml.com/
It should do the trick with something like that.

Yes, thanks. It seems the right tool.

One AI that might work for you is Runway, which allows for specific input and can generate videos with complex effects like wind or water simulations. You can try using Runway with a prompt like “Simulate a strong wind blowing on the umbrellas in this beach scene” or “Create a video of a hurricane affecting the umbrellas on this sunny beach”.

Same here: I have been using Runway to “animate” photos to use later in my comp. Recently I animated a dove wings flapping. ComfyUI is also an excellent choice to use in your local machine so no credits required. Although it is more difficult to use than Runway.

Finally, I did it using runaway. Prompt is quite tricky. Final animation is not of such high quality. But I only needed to add some detail to an static layer integrated in a background. It’s at the limit of quality to be usable. But enough for me.

2 Likes