MidJourney + RunwayML Workflow Magic
![MidJourney + RunwayML Workflow Magic](/assets/images/tokyo-modern.gif)
MidJourney + RunwayML Workflow Magic
AUGUST 17, 2024
I'm fascinated by the potential of AI in creative fields. This project showcases how I've used MidJourney and RunwayML to visualize some of the world's greatest cities during their prime times, blending historical essence with modern AI techniques. I freaking love this stuff. We will be able to step into any time in history, generate a custom movie that helps us understand and experience how amazing those places were.
The journey started with generating still images in MidJourney, capturing the unique atmosphere of cities like Tokyo in 2024, Cairo in 1260, and Paris in 1889. These images served as the foundation for more dynamic explorations.
Using RunwayML, I transformed these stills into engaging animations that provide a deeper sense of the life and movement within these cities. Here are some highlights from this exploration:
Here are GIFs of the generated movies:
![Tokyo 2024](/assets/videos/tokyo-modern.gif)
![Cairo 1260](/assets/videos/cairo-1260.gif)
![Istanbul 532](/assets/videos/istanbul-532.gif)
![Kyoto 1693](/assets/videos/kyoto-1693.gif)
![Paris 1889](/assets/videos/paris-1889.gif)
![Venice 1500](/assets/videos/venice-1500.gif)
Here are initial MidJourney generated key frame and then the hires RunwayML generated movie:
Tokyo 2024
![Tokyo 2024](/assets/images/tokyo-modern.webp)
Paris 1889
![Paris 1889](/assets/images/paris-1889.webp)
Cairo 1260
![Cairo 1260](/assets/images/cairo-1260.webp)
Istanbul 532
![Istanbul 532](/assets/images/istanbul-532.webp)
Kyoto 1693
![Kyoto 1693](/assets/images/kyoto-1693.webp)
Venice 1500
![Venice 1500](/assets/images/venice-1500.webp)
Each animation captures the essence of its respective city, offering a window into what makes each place unique. This project not only highlights my capabilities in utilizing AI for creative visualizations but also serves as a testament to the historical and cultural significance of these cities.
Here is the basic prompt that I used to create these. With a little tweaking and iteration, I could definitely create a world class short film.
FPV hyper-speed fly through Cairo, Egypt in the year 1260 AD. Dynamic motion, dynamic blur, timelapse, 30x speed, cinematic 35mm film with rich accurate color