The company is bringing its Firefly generative AI tools to Creative Cloud apps like Premiere Pro.
This week Adobe announced that it is adding a generative AI features to Premiere Pro, the company’s widely used video editing application. It adds the AI features through Adobe Firefly, a series of generative AI models that the company launched earlier this year.
Firefly is similar to the likes of DALL-E and Midjourney. Like them, it can create images and text effects just from written descriptions.
Ashley Still, Adobe’s SVP for Digital Media, described the new AI-driven video processing offering in a blog post. “For more than three decades, Adobe’s family of video and audio apps have been the tools-of-choice for the worlds’ most talented creative pros,” she boasted.
Still explains that Premiere Pro is receiving an AI feature that can automatically create storyboards from a script provided by the user. “Moreover, the feature is capable of generating previsualizations”, she adds. A previsualization is a 3D animation that, similarly to a storyboard, provides a preview of how a scene will unfold. “Creators can dramatically accelerate pre-production, production and post-production workflows using AI analysis of script to text to automatically create storyboards and previsualizations, as well as recommending b-roll clips for rough or final cuts”, Still writes.
Playing catch-up with DALL-E
Adobe has differentiated Firefly from those other generative AI services by leveraging its own legacy position in the creative domain. Specifically, Firefly wasn’t trained on externally sourced (or “stolen”) photos like the other generative AI platforms. As Still points out, developers trained Firefly “on Adobe Stock images, openly licensed content, and public domain content where copyright has expired.” As a result, Adobe has designed it to generate content safe for commercial use.
This exclusivity in image sourcing has the near term result that Firefly is currently lagging behind the capability of its competitors. However, long term it should be able to overtake DALL-E and the others.
Still’s enthusiasm for the new technology is palpable. “Firefly is now available in beta (try it out!)”, she writes, adding that Adobe has “shared concepts for how Firefly could be integrated into Adobe Photoshop, Adobe Illustrator and other Adobe applications in the near future”.
5 hours ago
