Peripheral Labs: Self-Driving Car Sensors Enhance Sports Fan Experience

The Evolving Landscape of Sports Viewing and Peripheral Labs' Innovative Approach

Recent analyses indicate a decrease in live sports viewership, particularly within the Gen Z demographic. In response, sports leagues and broadcasting networks are actively seeking methods to enhance fan engagement through diverse viewing options, detailed statistics, and in-depth analytical content.

A key strategy involves the implementation of volumetric video generation, offering viewers the ability to observe game action from multiple perspectives, replicating a video game-like experience. This technology relies on a network of cameras to capture footage in three dimensions, allowing for observation from various vantage points.

Introducing Peripheral Labs

Peripheral Labs, a Canada-based company, is dedicated to making this advanced technology accessible to a wider range of leagues, teams, and ultimately, fans. Their goal is to lower the barriers to entry for volumetric video implementation.

Founded in 2024 by Kelvin Cui and Mustafa Khan, the company draws upon the founders’ extensive experience in autonomous vehicle technology. Both previously contributed to the University of Toronto’s award-winning self-driving car team.

Khan’s background includes research roles at Huawei, while Cui served as a software engineer at Tesla, focusing on chassis systems. “Mustafa and I share a deep passion for sports,” Cui explained in an interview. “His loyalty lies with Arsenal, and I’ve been a Vancouver Canucks fan since childhood. When Mustafa demonstrated his 3D reconstruction research, I immediately envisioned the potential for a more immersive hockey viewing experience.”

Leveraging AI and Computer Vision

The company acknowledges that volumetric generation isn’t a novel concept. However, they believe that recent advancements in artificial intelligence and computer vision have created a favorable environment for widespread adoption of the technology.

Peripheral Labs is applying principles from the field of self-driving cars – specifically robotics perception and 3D vision – to the reconstruction of sports video. This approach allows for a significant reduction in the number of cameras required, potentially from over 100 to as few as 32, thereby lowering costs and simplifying operations.

The startup intends to minimize hardware expenses for teams and broadcasters, structuring its business model around multi-year platform contracts.

Enhanced Data and Viewing Control

The software platform will integrate biomechanical data and performance statistics for teams and leagues, utilizing a sensor suite comparable to those found in autonomous vehicles. This will provide detailed depth perception of the playing field.

Broadcasters and fans will gain unprecedented control over the viewing experience through photorealistic 3D reconstruction. For example, viewers could isolate and track a specific player, or freeze a moment to analyze a play from multiple angles.

“Our expertise in robotics and machine learning, combined with our ability to adapt off-the-shelf cameras, provides a competitive advantage in both platform development and scalability – from small practice facilities to large stadiums,” Cui stated.

Detailed Player Analysis

The platform’s software can track various joint movements, including finger flexion, to provide detailed biomechanical measurements. For instance, the system can measure knee and ankle flexion during athletic movements, offering coaches valuable insights into player positioning and flexibility.

Funding and Future Outlook

Peripheral Labs has secured $3.6 million in seed funding, led by Khosla Ventures, with participation from Daybreak Capital, Entrepreneurs First, and Transpose Platform.

Joe Ros, a partner at Entrepreneurs First, highlighted the strong following the founders and their autonomous driving team have at the University of Toronto. He also noted that investors are often cautious about sports-related ventures, but recognize Peripheral Labs’ potential as an entertainment offering.

“The ultimate consumer is the viewer, and the demand for sports content remains consistently high. Peripheral Labs is poised to establish a new standard for sports consumption – immersive, volumetric video. Their current work in sports will create a technological advantage and market dominance,” Ros explained.

The company carefully selected its venture capital partners for their expertise in product development and go-to-market strategies. Currently employing 10 engineers, Peripheral Labs plans to expand its team, focusing on platform and hardware development to further reduce costs, minimize latency, and enhance the resolution of 3D reconstructions.

While specific partnerships remain undisclosed, Peripheral Labs is currently in discussions with several teams and leagues across North America. The company operates within a competitive landscape, facing competition from other volumetric capture startups such as Arcturus Studios.