AR for iOS Developers: RealityKit and Reality Composer

1h 28mIntermediate2019-11-15

Authors

Brian Advent

Software Developer, Educator, Mathematician

Course details

With the RealityKit framework, you can integrate virtual objects into the real world to build striking augmented reality (AR) experiences. Reality Composer, a powerful new app for iOS and Mac, makes it easy to create 3D content that you can add to the app you're building with RealityKit. In this course, learn the fundamentals of working with RealityKit, as well as how to use Reality Composer to create interactive AR experiences with no prior 3D experience. After showing you how to quickly build an AR app with RealityKit, instructor Brian Advent demonstrates how to create content and interactions with Reality Composer. Then, see how to use Reality Composer and Xcode together to create apps that display content based on 2D images and 3D objects found in the real world.

Learning objectives
Building 3D scenes with Reality Composer
Adding interactivity using behaviors
Converting 3D OBJ files to USDZ files
Handling user interactions in code
2D image recognition and image anchors
Scanning and detecting 3D objects

Skills covered

iOS DevelopmentAugmented RealityiOSMobile DevelopmentAppleVisualization and Real-TimeProduct and ManufacturingOne-Off

Concepts

Introduction

2D and 3D images with Reality Composer
What you should know

A First AR App and Some Theory

Build an AR app with four lines of code
RealityKit basics

Create 3D Content

Introduction into Reality Composer
Build your first scene
Add behaviours
Working with USDZ files
Convert 3D OBJ files to USDZ
Your content in Xcode
Challenge - A solar system
Solution - A solar system

2D Image Recognition

A planet detector app
Project setup
Image recognition with image anchors
Load content into your app
Handle user actions from Reality Composer
Trigger Reality Composer actions in code
Challenge - Solar detect
Solution - Solar detect

3D Object Detection

How to scan 3D objects
An object detection app in five minutes

Conclusion

Next steps