Dream Machine has shaken up the world of Generative AI since its release. It has been producing 5-second snippets which have left everyone shocked and in awe of its video quality, object scene, and frame reconstruction.
We have witnessed almost every content creator out there, feed Dream Machine with the most descriptive prompts and get amazing video outputs as a result, capturing almost every prompt word in action.
However, is Dream Machine as good as Sora? Many have raised questions and debates on this matter, some claim Dream Machine is better at capturing prompts and expressing them in videos, however on the other hand some have criticized the short 5-second duration from Luma AI.
In this article, we will analyze video creations from both Sora and Dream Machine based on the same prompt, compare them side by side notice all the details, and overall decide which of the two is the better Generative AI tool for videos.
5 Side By Side Comparisons Between Sora and Dream Machine
Here are 5 comparisons between the videos generated by Sora and Dream Machine based on the same prompt. The Sora Videos have been taken from their official website along with their prompts. The same prompt has been used with Dream Machine to get the output videos. Please note I haven’t considered the video durations as a deciding factor as we all know Dream Machine can only generate 5 seconds of video snippets which is lesser than Sora’s.
The videos from both Sora and Luma have been arranged side by side and will be played together to give you a better look and faster understanding.
1. Several Giantly Mammoths
Prompt: “Several giant wooly mammoths approach treading through a snowy meadow, their long wooly fur lightly blows in the wind as they walk, snow covered trees and dramatic snow capped mountains in the distance, mid afternoon light with wispy clouds and a sun high in the distance creates a warm glow, the low camera view is stunning capturing the large furry mammal with beautiful photography, depth of field.”
I compared videos from both Sora and Luma AI's Dream Machine. The comparison was done on similar prompts. The side by side comparisons look great. Which one do you think is better?
— Xenesis26 (@xenesis26) June 14, 2024
1. Several Giantly Mammoths#LumaAI #Sora #LumaDreamMachine #OpenAI pic.twitter.com/SyqwisYdAQ
Let’s begin with the Sora Video. The picture and object quality look too pristine and sharp details are there. The mammoth’s foot actions while walking towards the screen are amazing. Great use of mechanics. Also the background white icy smoke gives it a more realistic feel.
We gave the same prompt to Dream Machine and the video obtained was good, but not as good as Sora. The mammoths in this video look too small and more of animated (than real). However, the background looks good and has good details, especially the mountains. The camera action here is opposite to that of Sora’s as the mammoths are moving on a side view.
However, if you were to choose the winner I would say Sora takes the lead here on two main factors, firstly the object quality and second the more realistic feel mainly from Sora’s background icy smoke and the fine details. Dream Machine has done well but it couldn’t match Sora’s excellence.
Scores: Sora – 1, Dream Machine – 0
2. A Stylish Woman In Tokyo
Prompt: “A stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage. She wears a black leather jacket, a long red dress, and black boots, and carries a black purse. She wears sunglasses and red lipstick. She walks confidently and casually. The street is damp and reflective, creating a mirror effect of the colorful lights. Many pedestrians walk about.”
2. A stylish woman in Tokyo pic.twitter.com/vMtyv1deEc
— Xenesis26 (@xenesis26) June 14, 2024
This is the prompt that generated Sora’s iconic video of the Tokyo Lady. We already know what an impact this video made worldwide. The video looks straight out of a movie scene. The lady, the lights, the background buildings, and the street reflections look too much realistic. And the way the lady walks makes it look more like a real-life recording.
Now we tried the same prompt with Dream Machine, and I was so shocked! The lady looked so similar to the one in the Sora video. How is the resemblance so similar? I get that the prompt is the same but the resemblance is uncanny. But the background here looks better and is more luminous compared to Sora. Sora has better quality but Dream Machine has given us more depth.
It would be hard to choose a fixed winner here. I would call this one a tie, as the lady looks too similar in both videos. Also, Sora has better quality again but this time it’s countered by more background depth in Dream Machine.
Scores: Sora – 2, Dream Machine – 1
3. A Short Fluffy Monster
Prompt: “Animated scene features a close-up of a short fluffy monster kneeling beside a melting red candle. The art style is 3D and realistic, with a focus on lighting and texture. The mood of the painting is one of wonder and curiosity, as the monster gazes at the flame with wide eyes and open mouth. Its pose and expression convey a sense of innocence and playfulness, as if it is exploring the world around it for the first time. The use of warm colors and dramatic lighting further enhances the cozy atmosphere of the image.”
3. A Short Fluffy Monster pic.twitter.com/5G8h8jHNXs
— Xenesis26 (@xenesis26) June 14, 2024
Let’s begin with Sora’s video. The monster here looks well generated with good design and features. Also what’s more interesting is how the candle glows almost looking like an actual flame. The monster’s curious movements by wanting to touch the flame give the video more life and exposure. Also, the eye movements make the monster look more playful and realistic.
Now looking at the Dream Machine video. What I can say, there’s no such curious body movement from the monster, it simply looks to be standing and exploring the flame. I don’t see any deep facial expressions like wide eyes and open mouth as asked in the prompt. However the objects and picture quality are good, they add good depth and exposure to the resultant video.
The winner here is Sora based on the movement mechanics of the object. The Sora video captures the prompt better as we can see in the monster’s movements. It looks more realistic and far more interesting.
Scores: Sora – 3, Dream Machine – 1
4. A Glass Sphere with a Zen Garden
Prompt: “A close up view of a glass sphere that has a zen garden within it. There is a small dwarf in the sphere who is raking the zen garden and creating patterns in the sand.”
4. A Glass Sphere with a Zen Garden pic.twitter.com/g2zZw3uoHN
— Xenesis26 (@xenesis26) June 14, 2024
Let’s begin with the Sora Video. The video looks crystal clear and the garden looks well designed and oriented with the objects. The glass sphere also looks very realistic thanks to the reflections on it. Also, we can see the dwarf miniature in the sphere raking the zen garden. Overall, a perfect prompt illustration from Sora in a well-defined video.
Now let’s look at Dream Machine’s video. Firstly there’s a zen garden but not so well designed and with a broad view as we witnessed in Sora’s Video. However, the picture quality is good, this time on par with Sora.
But if we have to choose a winner, this time it’s easily Sora. I don’t see any dwarf movement in Dream Machine’s video, as the prompt mentioned a raking movement creating patterns in the sand. You can see from the glass sphere video, there is a difference in luma. Luma is not giving a dwarf and instead of the dwarf, the human hand came in to create patterns in garden. So, in this prompt, Luma’s video is not accurate.
Scores: Sora – 4, Dream Machine – 1
5. A Chinese Lunar New Year Celebration with Dragon
Prompt: “A Chinese Lunar New Year celebration video with Chinese Dragon.”
5. A Chinese Lunar New Year Celebration with Dragon pic.twitter.com/y3vHnu8lwk
— Xenesis26 (@xenesis26) June 14, 2024
Starting with the Sora video. The dragon looks well-designed, and the crowd here looks enormous. A perfect representation of the Chinese New Year celebration. Also, almost everyone in the crowd looks to be expressing emotions and celebrating. It’s great of Sora AI to capture so many things even without a descriptive prompt.
Now let’s talk about Dream Machine’s video. This video has more of a Chinese New Year touch considering the red attire, the red lamps attached, and the splashing red decorations flying in the air. The crowd looks a bit smaller here but this video gives a more celebratory feel compared to the one in Sora one.
Here I would consider the winner to be Dream Machine, considering the extra decorations it has added in the background to give a more celebratory vibe. Sora’s video is good too but it looks more like a parade to me than a celebration. Good of Dream Machine to consider these small details even when the prompt was not so expressive. These minor enhancements(red decorations) made a big difference.
Scores: Sora – 4, Dream Machine – 2
Who is the Overall Winner?
Based on the scores, the justified winner is Sora. Sora was better at expressing the prompt ideas and capturing object details in almost every case. Also the picture quality was far better in Sora. Dream Machine has also done well in producing well described videos but it lacks that picture perfect clarity and detailed representation we found in Sora.
However, I must say Dream Machine is doing quite well for a beginner video generating model. And the production time it takes to produce 5 second clips is quite impressive thanks to it’s iteration speed of almost 120 frames in 120 seconds. Luma will continue to enhance the model and bring more updates but we shouldn’t forget that it’s open source and we should keep exploring it as long as we can.
Conclusion
In these videos, Sora AI has taken the lead, but for now, we have to give Dream Machine more time as it will continue to evolve with more and more updates. This is just the beginning of the video generation era for Dream Machine and I believe it is slowly getting there. We hope to do a even more detailed test once Sora AI drops out for public access.