FACEBOOK founder Mark Zuckerberg has been the first-ever interview subject in the metaverse, in a video that has stunned onlookers.
The metaverse is a virtual world created by Zuckerberg’s tech company Meta.
When Zuckerberg first appeared in the metaverse in two dimensional form, the $177billion project was widely mocked online.
However, the tech billionaire and Lex Fridman, computer scientist and podcaster, have released a video of the pair having a conversation in the virtual world.
They look as though they are talking face to face, and yet, are more than a thousand miles a part.
The duo appear as 3D hyper-realistic avatars, thanks to Meta’s Codec Avatar research.
Fridman, clearly shocked by what he’s seeing, says: “It’s you. It’s really you, but you’re not here with me.”
Describing the photo-realistic avatars, he adds: “It captures everything.
“The flaws, the subtleties of the human face… it makes it all the more immersive.”
Both Zuckerberg and Fridman were scanned head-to-torso to create the Codec Avatars in Meta’s Pittsburgh Reality Lab.
So, instead of relying on cartoon avatars or video transmitting, their bodies and facial expressions have been scanned to create an hyper-realistic computer model of their appearance.
This computer model is then “collapsed” into a Codec, as Zuckerberg details.
Then, when users wear Meta’s Meta Quest headsets, the gear can see your facial expressions and send a coded version into the metaverse.
Zuckerberg describes the photorealistic experience as “magical”.
It delivers a “sense of presence as if you’re there together, no matter actually where you are in the world,” he adds.
Zuckerberg said: “This experience is a good embodiment of that, where it’s like we’re in two different states half way across the country and it looks like you’re sitting right in front of me.
“It’s wild.”
Fridman goes on: “I’m almost getting emotional.
“It feels like a totally fundamentally new experience.
“Like for me to be able to have theses kind of conversations with loved ones, it would just change everything.”
No hands
However, Meta has yet to figure out how to translate arms into the metaverse or anything from the torso down, which Zuckerberg admits the company is still working on.
Fridman also notes that the scanning, while still only half of the body, was a “lengthy process”, spanning several hours.
But Zuckerberg hopes this process can be condensed down to two or three minutes and eventually completed via mobile phones – instead of a pricey trip to Pittsburgh.
Zuckerberg continues: “It’s one of the last pieces that we need to really nail, and then there’s all the experiences around it.
“Part of the vision for this over time is not just have this be like a video call… but the thing that you can in the metaverse is different from what you can do with a phone.
“It’s doing stuff where you’re physically there together.”
Source: https://www.the-sun.com/tech/9209911/mark-zuckerberg-lex-fridman-interview-metaverse/