google is making a 3d, life-size video calling booth
Google's Project Starline: A Leap Towards Lifelike Video Calls
Google is currently developing Project Starline, an innovative video calling system. This system utilizes 3D imagery displayed on a specialized 3D display to generate remarkably realistic representations of individuals during video conferences.
The Core Technology and Initial Reactions
Although still in the experimental phase, Project Starline represents a culmination of extensive research and strategic acquisitions by Google. The goal is to establish a foundation for video meetings that feel significantly more personal and engaging.
Initial demonstrations involved unsuspecting participants entering a room equipped with a concealed screen and camera arrangement. Upon activation, the screen displayed a video feed of a remote individual, but with an unprecedented level of realism.
Participants expressed profound reactions, including:
- “I could genuinely sense her presence and see her; it was a truly immersive 3D experience, as if she were physically here.”
- “It felt as though I could actually reach out and touch him!”
- “The experience created a strong sensation of being in the same room with her.”
How Project Starline Achieves its 3D Effect
According to CEO Sundar Pichai, this immersive “experience” is enabled by the integration of high-resolution cameras and custom-designed depth sensors. These technologies are closely linked to Google’s ongoing research into transforming videos of people and environments into interactive 3D representations.
The system employs numerous cameras and sensors, strategically positioned around the display, to capture a person's image from multiple perspectives. This data is then processed to accurately determine their shape, creating a dynamic, real-time 3D model.
This model, along with detailed color and lighting information, is efficiently compressed and transmitted to the recipient’s setup. The receiving system then renders the image in convincing 3D, dynamically adjusting the perspective based on the viewer’s head and body movements.
The Role of Light Field Display Technology
Despite the past challenges with 3D television – largely due to the inconvenience of specialized glasses and subpar image quality – Project Starline delivers a unique 3D visual experience. Pichai attributes this to the development of a “breakthrough light field display.”
This advancement was likely facilitated by the acquisition of Lytro, a light field camera company that ceased operations in 2018. Lytro possessed valuable intellectual property and expertise in this field.
Light field technology creates and displays 3D imagery through complex techniques that are difficult to convey in traditional 2D formats. Companies like Looking Glass have successfully developed light field displays that produce captivating 3D visuals, resembling miniature holograms.
Future Prospects and Applications
While the precise methodology employed by Google may differ, the resulting effect appears equally impressive, as evidenced by participant feedback. Google is currently conducting internal testing and preparing to deploy units to partners across various sectors, including healthcare, where a strong sense of presence is crucial.
Currently, Project Starline remains a prototype and is likely to be exceptionally expensive. Widespread consumer availability is not anticipated in the immediate future. However, the possibility of a consumer-grade version of this light field technology emerging in the future is not unrealistic.
Google has indicated that further details regarding Project Starline will be shared later this year.