Adobe Firefly's New AI Tools Are Designed To Reduce Boring Work For Editors

Adobe stated that, less than a month after launching its new Firefly generative AI editing capabilities, it is already working on a slew of enhancements to better empower its customers through Creative Cloud video and audio applications. The updates should arrive in Firefly’s beta program later this year.

Firefly is a collection of generative AI models built from the company’s long-running AI program, Sensei, that can produce and alter audio, video, graphics, and 3D models using text prompts in the same way as Dall-E and ChatGPT can. The capabilities of Firefly are now available in Adobe’s ecosystem, including Premiere Pro, Illustrator, After Effects, and Photoshop, and will be available through the limited beta program later this year.

The new features were recently announced, and are intended to help professional editors save time by boosting color levels, inserting placeholder images, adding effects, and autonomously recommending b-roll for a given project — all by simply typing their ideas into Firefly’s AI text prompt and letting the algorithm do its thing. This will incorporate “text to color enhancements,” a comprehensive capacity that may change the brightness and saturation levels, as well as the time of day and year, utilizing natural language cues.The generative AI features will extend to audio as well, with the ability to introduce background music and sound effects by explaining what they want to the editor via text. The animated typeface features seen at last month’s premiere event, as well as an automatic b-roll function that analyzes script content to build storyboards and propose video clips, are anticipated to appear soon. Most notably, Firefly will provide customized how-to instructions to educate new users through the process of using these capabilities.