I have a picture (some umbrellas in a sunny beach) and I’d like generate a video in a specifical way, simulating a strong wind or a hurricane is affecting the umbrellas. All AI’s I have found only make pans or camera movements. I’d need an specifical prompt to give it specifical input.
One AI that might work for you is Runway, which allows for specific input and can generate videos with complex effects like wind or water simulations. You can try using Runway with a prompt like “Simulate a strong wind blowing on the umbrellas in this beach scene” or “Create a video of a hurricane affecting the umbrellas on this sunny beach”.
Same here: I have been using Runway to “animate” photos to use later in my comp. Recently I animated a dove wings flapping. ComfyUI is also an excellent choice to use in your local machine so no credits required. Although it is more difficult to use than Runway.
Finally, I did it using runaway. Prompt is quite tricky. Final animation is not of such high quality. But I only needed to add some detail to an static layer integrated in a background. It’s at the limit of quality to be usable. But enough for me.