MidJourney + RunwayML Workflow Magic
MidJourney + RunwayML Workflow Magic
AUGUST 17, 2024
I'm fascinated by the potential of AI in creative fields. This project showcases how I've used MidJourney and RunwayML to visualize some of the world's greatest cities during their prime times, blending historical essence with modern AI techniques. I freaking love this stuff. We will be able to step into any time in history, generate a custom movie that helps us understand and experience how amazing those places were.
The journey started with generating still images in MidJourney, capturing the unique atmosphere of cities like Tokyo in 2024, Cairo in 1260, and Paris in 1889. These images served as the foundation for more dynamic explorations.
Using RunwayML, I transformed these stills into engaging animations that provide a deeper sense of the life and movement within these cities. Here are some highlights from this exploration:
Here are GIFs of the generated movies:
Here are initial MidJourney generated key frame and then the hires RunwayML generated movie:
Tokyo 2024
Paris 1889
Cairo 1260
Istanbul 532
Kyoto 1693
Venice 1500
Each animation captures the essence of its respective city, offering a window into what makes each place unique. This project not only highlights my capabilities in utilizing AI for creative visualizations but also serves as a testament to the historical and cultural significance of these cities.
Here is the basic prompt that I used to create these. With a little tweaking and iteration, I could definitely create a world class short film.
FPV hyper-speed fly through Cairo, Egypt in the year 1260 AD. Dynamic motion, dynamic blur, timelapse, 30x speed, cinematic 35mm film with rich accurate color