New items in Apple’s AR line are Reality Composer and RealityKit.
Apple held its annual WWDC developer conference and unveiled its latest plans for Augmented Reality (AR), in particular ARKit. Originally released in 2017 along with iOS 11, the software changes in 2019 when Apple launches ARKit 3 with some major additions, such as people occlusion and motion capture.
If you have ever used basic AR applications and video games, such as Pokemon GO, you will notice how digital objects and characters simply fit over the real world, rather than being fully integrated into it. By this we mean walking behind and in front of the object, and not directly through it. So with people, Occulsion AR can be even more realistic, allowing you to embed effects like a green screen almost anywhere.
Thanks to computer vision, Apple demonstrated motion capture technology for ARKit 3. Using only one camera, users capture the movement of someone in real time, which can then be transmitted directly to the AR experience. While the demonstration shown looked a bit rough with a digital character moving slightly without moving the legs, the software could still track joints, such as elbows or knees.
In fact, ARKit 3 had quite a few additions that Apple didn’t go into details about during the presentation. Some of them consisted of multiple face tracking that could recognize three faces at once. The company also did not address the topic of joint sessions, which are ideal for AR developers or multiplayer games, while using front and rear cameras and improving the detection of 3D objects.
Working in tune with ARKit 3, the software was designed to make things easier for RealityKit and Reality Composer developers. Designed to help developers who do not have much experience with the 3D modeling needed for AR, RealityKit is said to offer features such as photorealistic rendering, camera effects, animation, and physics.
“RealityKit easily mixes virtual content with the real world using realistic materials on a physical basis, reflections of the environment, ground shadows, camera noise, motion blur, and more, making virtual content almost indistinguishable from reality,” explains Apple.
While the Reality Composer offers a library of assets, stationary or animated for developers, to quickly and simply drag and drop them into RealityKit. Reality Composer can also be used with Xcode, so developers can create, test, customize and simulate AR impressions completely on an iPhone or iPad.
ARKit 3 is expected later this year, when additional details will appear VRcue will inform you about this.