Luma AI: Generate Videos from Start and End Frames

Luma AI Unveils Ray3 Modify for Advanced Video Editing

Luma, a company specializing in AI-powered video and 3D models and backed by a16z, has announced the release of its latest model, Ray3 Modify.

This new tool empowers users to alter existing video footage by utilizing character reference images, crucially preserving the original performance nuances.

Preserving Performance with AI-Driven Modifications

The core functionality of Ray3 Modify centers around maintaining the integrity of the original footage while enabling creative alterations.

Users can specify both a starting and ending frame, allowing the model to intelligently generate transitional footage that seamlessly integrates with the existing content.

Addressing Challenges in Creative Studios

According to Luma, Ray3 Modify directly addresses the difficulties studios face when attempting to edit or generate effects using AI without compromising the quality of human performance.

The model is designed to closely follow the input footage, enabling studios to leverage the talents of human actors for a wider range of creative and branding applications.

Luma emphasizes that the new model effectively retains the actor’s original motion, timing, eye line, and emotional delivery throughout the transformation process.

Character Transformation and Continuity

Ray3 Modify allows users to provide a character reference image, effectively transforming the appearance of the actor within the footage.

This capability extends to maintaining consistent details such as costumes, likeness, and overall identity throughout the duration of the shoot.

Controlling Transitions and Character Behavior

Beyond character appearance, users can also utilize start and end reference frames to precisely control video transitions.

This feature is particularly useful for directing character movements or behavior, ensuring seamless continuity between different scenes.

Luma AI's Vision for Creative Control

“Generative video models are incredibly expressive but also hard to control,” stated Amit Jain, co-founder and CEO of Luma AI.

“We are excited to introduce Ray3 Modify that blends the real-world with the expressivity of AI while giving full control to creatives.

This allows teams to capture performances and then immediately modify them – changing locations, costumes, or even reshooting scenes – all without the need for a physical reshoot.”

Availability and Funding

The new Ray3 Modify model is currently accessible to users through Luma’s Dream Machine platform.

This release follows the introduction of video modification capabilities in June 2025.

Luma recently secured $900 million in funding, led by Humain, an AI company owned by Saudi Arabia’s Public Investment Fund, in November.

Existing investors, including a16z, Amplify Partners, and Matrix Partners, also participated in this funding round.

Furthermore, Luma is collaborating with Humain to establish a 2GW AI cluster in Saudi Arabia.