MidJourney + RunwayML Workflow Magic

MidJourney + RunwayML Workflow Magic

MidJourney + RunwayML Workflow Magic

AUGUST 17, 2024

I'm fascinated by the potential of AI in creative fields. This project showcases how I've used MidJourney and RunwayML to visualize some of the world's greatest cities during their prime times, blending historical essence with modern AI techniques. I freaking love this stuff. We will be able to step into any time in history, generate a custom movie that helps us understand and experience how amazing those places were.

The journey started with generating still images in MidJourney, capturing the unique atmosphere of cities like Tokyo in 2024, Cairo in 1260, and Paris in 1889. These images served as the foundation for more dynamic explorations.

Using RunwayML, I transformed these stills into engaging animations that provide a deeper sense of the life and movement within these cities. Here are some highlights from this exploration:

Here are GIFs of the generated movies:

Tokyo 2024 Cairo 1260 Istanbul 532 Kyoto 1693 Paris 1889 Venice 1500

Here are initial MidJourney generated key frame and then the hires RunwayML generated movie:

Tokyo 2024

Tokyo 2024

Paris 1889

Paris 1889

Cairo 1260

Cairo 1260

Istanbul 532

Istanbul 532

Kyoto 1693

Kyoto 1693

Venice 1500

Venice 1500

Each animation captures the essence of its respective city, offering a window into what makes each place unique. This project not only highlights my capabilities in utilizing AI for creative visualizations but also serves as a testament to the historical and cultural significance of these cities.

Here is the basic prompt that I used to create these. With a little tweaking and iteration, I could definitely create a world class short film.

FPV hyper-speed fly through Cairo, Egypt in the year 1260 AD. Dynamic motion, dynamic blur, timelapse, 30x speed, cinematic 35mm film with rich accurate color