CEO Sundar Pichai’s 11 Top Remarks At Google I/O 2021
‘We believe LaMDA’s natural conversation capabilities have the potential to make information and computing radically more accessible and easier to use,’ Pichai said.
We were all grateful to have videoconferencing over the last year. It helped us stay in touch with family and friends, and kept businesses and schools going. But there is no substitute for being together in the room with someone. So, several years ago, we kicked off a project to use technology to explore what’s possible. We call it Project Starline.
(The technology project enables people to “feel together, even when they’re cities or countries apart,” according to Google. The company likened it to looking though a “magic window” and seeing another life-size person in three dimensions and being able to talk naturally, gesture and make eye contact.)
It builds on the different areas of computer science I spoke about today and relies on custom-built hardware and highly specialized equipment. It’s early and currently available in just a few of our offices.
Some key advances have made this experience possible. First, using high-resolution cameras and custom-built depth sensors, we capture your shape and appearance from multiple perspectives, and then fuse them together to create an extremely detailed, real-time 3D model. The resulting data is huge -- many gigabits per second. To send this 3D imagery over existing networks, we developed novel compression and streaming algorithms that reduce the data by a factor of more than 100.
And we have developed a breakthrough light field display that shows you the realistic representation of someone sitting right in front of you in three dimensions. As you move your head and body, our system adjusts the images to match your perspective. You can talk naturally, gesture and make eye contact. It’s as close as we can get to the feeling of sitting across from someone. As sophisticated as the technology is, it vanishes, so you can focus on what’s most important.
With Project Starline, we have brought together a set of advanced technologies, with the goal of creating the best communications experience possible. We have spent thousands of hours testing it in our own offices, and the results are promising. There’s also excitement from our lead enterprise partners. We plan to expand access to partners in healthcare and media. In pushing the boundaries of remote collaboration, we have made technical advances that will improve our entire suite of communications products. We look forward to sharing more ways for you to get involved in the months ahead.