Spark AR Video Calling: Facebook's MultiPeer API Update

Facebook Unveils New Spark AR Features at F8

During the F8 developer conference, Facebook revealed advancements for Spark AR, its primary augmented reality creation tool. Since its initial announcement at F8 in 2017, over 600,000 creators across 190 nations have published more than 2 million AR effects on Facebook and Instagram.

According to Facebook, this makes it the largest mobile AR platform currently available. If you've ever utilized an effect on Instagram Stories to alter your hair color, or manipulated a dog’s facial expressions using your own, then you have experienced Spark AR.

Expanding AR Effects to Video Calls

Soon, these AR effects will be integrated into video calls on Messenger, Instagram, and Portal through the introduction of a Multipeer API. This allows creators to design effects that foster connection among call participants by utilizing a shared AR experience.

As an illustration, Facebook showcased a promotional video depicting a birthday celebration conducted via video call, where an AR party hat was virtually placed on each participant’s head.

Interactive Games for Video Calls

Developers will also be able to create games for users to enjoy during their video conversations. Similar games already exist on Facebook video calls – consider the challenge of catching AR hamburgers.

The opening of new game development possibilities to developers promises a wave of innovative games to engage friends during video calls.

Enhanced Capabilities with Multi-Class Segmentation

These video call effects and multipeer AR games will be further enhanced by Spark’s exclusive multi-class segmentation feature. This capability empowers developers to augment multiple segments of a user’s body simultaneously within a single effect, such as hair and skin.

Future of AR Glasses

Facebook also addressed its ongoing efforts to develop AR glasses. Chris Barbour, Director of Partnerships for Spark AR, indicated that the realization of this goal remains “years away.”

However, Barbour did offer a glimpse into potential features for this future wearable technology.

“Imagine the ability to virtually teleport to a friend’s living room to watch a show together, or to instantly share a captivating photo of a scenic hike,” Barbour explained. These concepts may seem less futuristic by the time the product is launched.

Supporting AR Creators

Last October, Spark AR introduced the AR Partner Network, a program designed for the platform’s most skilled creators. This year, Spark launched an AR curriculum through Facebook’s BluePrint Platform to assist creators in refining their AR effects.

Applications for the Spark Partner Network will be accepted again this summer. Currently, creators and developers can apply to begin building effects for video calling through the Spark AR Video Calling Beta.