iOS & Swift

Apple Augmented Reality by Tutorials

The best book to learn how to build realistic and immersive AR experiences for the Apple platform. Note: This book is in Early Access. You’ll get advance access to the book while it’s in development, and you’ll get a free update to the complete digital edition of the book when it’s complete! Estimated final release date: Fall 2020 By Chris Language.

Read for Free with the Personal Plan* * Includes this and all other books in our online library See all benefits
Buy Individually $59.99* *Includes access to all of our online reading features.
Leave a rating/review
Download materials
Comments
Save for later
Share

Who is this for?

This book is for beginner to intermediate iOS developers who already know the basics of Swift development and are looking to build immersive AR experiences for the Apple platform.

Covered concepts

  • Reality Composer & Reality Files
  • Reality Converter & PBR Materials
  • RealityKit
  • Facial Blend Shapes
  • ARKit
  • Raycasting & Physics
  • ECS & Collaborative Experiences
Learn Augmented Reality for the Apple Platform!

This book is the easiest and fastest way to get hands-on experience using Apple frameworks and technologies like Reality Composer, RealityKit, and ARKit — all the available rendering technologies Apple has to offer, as well as a collection of fun projects for creating...

more

Before You Begin

This section tells you a few things you need to know before you get started, such as what you’ll need for hardware and software, where to find the project files for this book, and more.

Section I: Reality Composer

Welcome to the first section of the book. In this section, you’ll dip your toes into the shallow end of augmented reality as you learn about AR Quick Look, Reality Composer, Reality and USDZ Files. You’ll create an interactive virtual drum kit that you’ll be able to share with your friends on iMessage.

1
Toggle description
Get up to speed quickly with your first project in AR.
2
Toggle description
Discover how to integrate AR Quick Look into your apps to give them some cool AR superpowers.
Find out how to leverage the power of Reality Composer to create interactive AR-based experiences.
Toggle description
Learn about USD and the USDZ file format, and find out how to convert your virtual content into this universal format using Python-based command-line tools.
Discover how PBR materials can add a level of realism to your AR objects, and how you can use Reality Converter to convert, view and customize USDZ content.

Section II: Reality Composer & Image Tracking

In this section, you’ll dive a little deeper into augmented reality and learn about image anchors and tracking. You’ll also create an interactive AR Business Card that you can show off to your friends, making them green with envy.

6
Toggle description
Learn how to use image anchors to scale and place virtual objects within the real world.
7
Toggle description
Spice up your reality apps with animations and sound effects using behaviors, triggers and actions.

Section III: Reality Composer & Object Tracking

In this section, you’ll add another dimension with Object tracking. Using object anchors, you’ll augment a physical toy truck with interactive buttons that will reveal some fun facts about its real-world counterpart.

Toggle description
Learn how to use object anchors to anchor AR content to physical objects within the real world, and take a tour of ARKit Scanner — an iOS app that lets you scan physical objects.

Section IV: RealityKit & Face Tracking

In this section, you’ll learn about RealityKit and face tracking. You’ll create a SnapChat-like face filter app with SwiftUI that lets you mockup your face with funny props. You’ll also create an animated mask that you can control with your eyes, brows and mouth.

Toggle description
Find out how to set up and use RealityKit to build a face-based augmented reality app.
Toggle description
Discover how you can use face anchors and face occlusion to track a user’s face and apply a virtual mask.
Toggle description
Build a fully interactive augmented reality face mask that reacts to your facial expressions using blend shapes.

Section V: ARKit & SpriteKit

In this section, you’ll get a full introduction to ARKit and find out what makes it so powerful. In doing so, you’ll create a fun 2D SpriteKit game where you get to save tiny Emoji’s before they fall to their death.

Toggle description
Get a complete introduction to ARKit, Apple's framework for creating fully interactive augmented reality, and learn about the different types of rendering options available with ARKit.
Toggle description
Discover how to combine ARKit and SpriteKit to create exciting augmented reality 2D games.
Toggle description
Learn about raycasting, 2D hit-testing and the SpriteKit physics engine as you add more features and functionality to your game.

Section VI: ARKit & SceneKit

In this section, you’ll continue learning about ARKit. You’ll also learn about SceneKit, Apple’s framework for creating 3D content, as you build a miniature interactive virtual airport that allows customers to access basic departure and arrivals information.

Toggle description
Find out how to use the power of SceneKit and ARKit together to create powerful 3D augmented reality scenes.
Toggle description
Discover how to detect, manage and use plane anchors and focus nodes. Learn how to enable environmental mapping and add lights and shadows.

Section VII: ECS & Collaborative Experiences (Bonus Section)

In this section, you’ll create a multiplayer AR shared experience using RealityKit. In this experience, two players can play a basic Knots & Crosses game on separate devices.

Toggle description
Build a collaborative AR experience and learn how to create and manage a multi-peer connection.