Innovative work was shown during F8 2019.
This week there were a lot of opportunities to participate in the Facebook (F8) 2019 developer conference, and not just the official launch of pre-orders and launch dates for Oculus Quest and Oculus Rift S. tried to solve, one of which was social interaction in virtual reality (VR). During the second day, Facebook introduced its latest prototype, the Oculus Avatars, which aims to transfer the entire body to VR.
The work is done by Facebook Reality Labs (FRL) in order to fully represent the user from head to toe in VR, which makes social interactions even smoother and more natural.
FRL Ronald Mallet began with a discussion of the project that the team showed a couple of months ago, namely about Codec Avatars, which was aimed at making avatars as photorealistic as possible. Although this, of course, is a huge leap in comparison with the current avatars available today, a huge amount of equipment was needed to scan user functions, plus it worked only from the shoulders.
Mallett noted that although much information can be extracted from the expression of someone’s face, the same works for the whole body, where the full movement can tell you about emotions, harmony, trust and empathy. It is necessary to create a body model that represents the human anatomy, but which must be fully adaptive in order to fit anyone automatically.
The construction of the FRL model began from the inside to the outside, designing an anatomically correct skeleton with the correct joints, from the movement of the shoulders to the movement of the joints. Then they compared the skeleton with the structure of the user’s body, which exactly followed the movements of the team members, and all thanks to one sensor — Mallett did not specify which sensor, if it was an ordinary Oculus.
Of course, we cannot all be represented as skeletons in VR, so the muscles were added to the model, helping to predict how they move and contract. Finally, leather and clothing were added as precisely as possible with a physical model of tissue deformations. It turned out the final prototype seen in the above image.
There are more ways of development before this technology will be ready for consumption, but it looks very promising. Oculus Rift users can now be happy with the expressive update of avatars. As more information is published, VRcue will let you know.