San Jose, CA—Adobe previewed Adobe Premiere Pro AI tools to enhance video creation and production workflows. New generative AI tools coming to Premiere Pro this year will help users streamline editing videos. This will include adding or removing objects in a scene or extending an existing clip. Further, these editing workflows are powered by a new video model that will join the family of Firefly models.
“Adobe is reimagining every step of video creation and production workflow to give creators new power and flexibility to realize their vision,” said Ashley Still, senior vice president, Creative Product Group at Adobe. “By bringing generative AI innovations deep into core Premiere Pro workflows, we are solving real pain points that video editors experience every day, while giving them more space to focus on their craft.”
Adobe also announced upcoming general availability of AI-powered audio workflows in Premiere Pro. They will comprise new fade handles, clip badges, dynamic waveforms as well as AI-based category tagging.
Additionally, Adobe previewed its vision for bringing third-party generative AI models into Adobe applications like Premiere Pro. Creative Cloud has always had a partner and plug-in ecosystem. This evolution expands Premiere Pro as a flexible, extensible professional video tool to fit any workflow.
Adobe noted that early explorations show how professional video editors could, in the future, leverage video generation models from OpenAI and Runway, integrated in Premiere Pro, to generate B-roll to edit into their project. It also shows how they could use Pika Labs with the Generative Extend tool to add a few seconds to the end of a shot.
Adobe Premiere Pro AI Tools Details
Adobe showcased a technology preview of generative AI workflows coming to Premiere Pro later this year, powered by a new video model for Firefly.
They include Generative Extend. This function adds frames to make clips longer, so it’s easier to time edits and add smooth transitions. This technology also solves a common problem professional editors run into every day. It allows them to create extra media for fine-tuning edits, to hold on a shot for an extra beat or to better cover a transition.
Further showcased was Object Addition & Removal. Users can select and track objects, then replace them. They can also remove unwanted items and change an actor’s wardrobe. They can also add set dressings such as a painting or photorealistic flowers on a desk.
Additionally, with Text to Video users can generate entirely new footage directly within Premiere Pro by typing text into a prompt or uploading reference images. They can use these clips to ideate and create storyboards as well as to create B-roll for augmenting live action footage.
Moreover, Adobe said it aims to provide industry-standard tools and seamless workflows that let users use any materials from any sources across any platform to create at the speed of their imaginations. Whether that means Adobe Firefly or other specialized AI models, Adobe is working to make the integration process as seamless as possible from its applications.
Content Credentials
Adobe has also developed its own AI models with a commitment to responsible innovation. It plans to apply what it’s learned to ensure that the integration of third-party models within its applications is consistent with the company’s safety standards.
As one of the founders of the Content Authenticity Initiative, Adobe pledges to attach Content Credentials—free, open-source technology that serves as a nutrition label for online content—to assets produced within its applications. Consequently, users can see how content was made and what AI models were used to generate the content created on Adobe platforms.
AI-Powered Audio Workflows in Premiere Pro
What’s more, Adobe will make new audio workflows in Premiere Pro generally available to customers in May. This will give editors the ability to control and improve the quality of their sound. The latest features include:
- Interactive fade handles. Editors can create custom audio transitions faster by dragging clip handles to create audio fades.
- New Essential Sound badge with audio category tagging. AI automatically tags audio clips as dialogue, music, sound effects or ambience. It also adds a new icon so editors get one-click access to the right controls for the job.
- Effect badges. New visual indicators make it easier to see which clips have effects, quickly add new ones as well as automatically open effect parameters right from the sequence.
- Redesigned waveforms in the timeline. Waveforms intelligently resize as the track height changes on clips, while gorgeous new colors make sequences easier to read.
