TikTok's First LiDAR AR Effect: A New Reality

TikTok has now incorporated the advanced capabilities of the iPhone 12 Pro’s LiDAR Scanner for augmented reality (AR) experiences, following Snapchat’s earlier adoption of the technology. The popular social video platform announced today the release of its inaugural lidar-powered effect, designed to help users celebrate the arrival of the new year. This effect showcases a virtual AR ball, reminiscent of the traditional Times Square New Year’s Eve ball drop. Following a countdown sequence, the ball descends and bursts, filling the user’s surroundings with digital confetti and a floating display of “2021.”

The support for LiDAR, which stands for light detection and ranging, was initially introduced with the latest iPhone 12 Pro and 12 Pro Max 5G models in the fall. This technology enhances the iPhone’s ability to perceive its environment by calculating the time it takes for light to travel to an object and return.

Combined with advancements in the iPhone’s machine learning features and developer tools, this enables more captivating and immersive AR experiences.

Snapchat was the first to utilize the new LiDAR Scanner, creating a Lens that allowed virtual flowers and grasses to flourish within a user’s physical space. This Lens featured digital vegetation that could even grow on walls and around furniture.

In a similar fashion, TikTok’s effect leverages LiDAR’s spatial understanding to ensure the confetti lands more convincingly after the ball’s explosion.

A demonstration video shared by the company on Twitter illustrated the confetti realistically covering surfaces like floors, sofas, and cushions, mirroring a real-world scenario. While not entirely flawless – the AR nature of the effect was still apparent – it represented a noticeable improvement over AR effects lacking comparable spatial awareness.

TikTok explained that the effect successfully blends the digital and physical realms through the way the AR elements interact with the user’s environment. It is currently accessible worldwide, excluding a limited number of countries.

Naturally, entertaining AR effects represent just one potential application of LiDAR technology. The technology is also being integrated into applications for creating 3D models through scanning, such as the 3D Scanner App, and those assisting with interior design, like RoomScan LiDAR, as well as games, including the Apple Arcade game, Hot Lava.

TikTok has indicated its intention to introduce “more innovative effects” throughout 2021.