Adobe Firefly Adds Prompt-Based Video Editing & Third-Party Models

Adobe Enhances Firefly with Advanced Video Editing Capabilities

Adobe is implementing updates to its artificial intelligence-powered video generation application, Firefly. These enhancements include a new video editor enabling precise, prompt-driven modifications.

Furthermore, the platform is integrating additional third-party models for both image and video creation, notably Black Forest Labs’ FLUX.2 and Topaz Astra.

New Prompt-Based Editing Features

Previously, Firefly operated solely on complete, prompt-based generation. Any undesirable element within a video necessitated a full recreation of the clip.

The newly introduced editor allows users to refine video elements, adjust colors, and alter camera angles using textual prompts. A new timeline view is also available, facilitating adjustments to frames, audio, and other video characteristics.

This new video editor was initially unveiled in October as a private beta and is now being released to all users.

Leveraging Third-Party Models

Utilizing Runway’s Aleph model, users can now provide Firefly with specific instructions. For example, alterations like “Change the sky to overcast and lower the contrast” or “Zoom in slightly on the main subject” can be implemented.

With Adobe’s Firefly Video model, users can upload a starting frame and a reference video demonstrating a desired camera movement. The system will then replicate that camera angle within their current video project.

The integration of Topaz Labs’ Astra model enables video upscaling to resolutions of 1080p or 4K.

Expanding Capabilities and Accessibility

Black Forest Labs’ FLUX.2 image generation model is also being added to the application, alongside a new collaborative boards feature.

FLUX.2 is immediately available on Firefly across all platforms. Adobe Express users will gain access to FLUX.2 starting in January.

Competitive Landscape and Promotional Offers

In response to emerging models from competitors in the image and video generation space, Adobe aims to increase user engagement with its application.

Subscribers to Firefly Pro, Firefly Premium, the 7,000-credit plan, and the 50,000-credit plan will receive unlimited generations from all image models and the Adobe Firefly Video Model within the Firefly app until January 15.

Ongoing Development and Integration

Throughout this year, Adobe has implemented numerous changes to its Firefly models and applications.

In February, a subscription service was launched, providing access to varying levels of image and video generation. Subsequently, a new Firefly web application and mobile apps were released, and support for additional third-party models was integrated into the Firefly app.