Getting started with RealityKit

Part 0: A high level intro to the latest AR framework

Before WWDC19, myself and other Augmented Reality (AR) enthusiasts were anticipating many updates to SceneKit to come along with some shiny new ARKit features; however this was not the case.

Instead Apple decided to create a whole new framework to implement AR, and dubbed this new framework RealityKit. Here we have a whole new rendering engine, made from the ground up with AR not just in mind, but as the top priority. Although there may be some features missing; with this as v1.0 I have high hopes that this will become the standard for high-performance AR. Due to the name I also believe it could be intended for use with both Augmented and Virtual Reality, but I have yet to see any evidence for this.

Craig Federighi and his fantastic hair introducing RealityKit at WWDC19, source:

I started looking into RealityKit right from the start, however there’s currently limited materials out there helping people to find their feet, both if someone who is new to AR or is coming from other AR Frameworks, such as SceneKit. This collection of articles aims to get you started with understanding the new format of creating AR content programmatically with RealityKit, with new articles coming out as I use the features.


To see what was changed with RealityKit during WWDC 2020, refer to this story:

The Collection

If you want to skip ahead and see code examples without support material; take a look at this repository below. In this repo I’m adding the new features together into a use-case, a game. Similar to one that Apple showed off at WWDC19, for which they have yet to release the code for.

If you have any suggestions of better methods of implementing Apple’s new framework, I encourage you to open a Pull Request on the above repository so everyone can benefit!

If you’ve enjoyed this article and want to see more in this RealityKit series follow me for updates or check out my Twitter. Also be sure to tap the 👏 button (you can do this 50 times 😱)




Excited about all things Augmented Reality! Developer Evangelist at

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Build iOS apps in 10 days | Understanding Apple Developer Ecosystem

5 Most Useful Homescreen Widgets for iOS 14 — (January 2021)

Swift Programming Tutorial: Final Class

Decoupling SwiftUI Views for Reusability

Unwinding Segues in SwiftUI

Great iOS Developer Newsletters you should subscribe to. [Updated — Oct 2020]

11 Popular Writing Apps for Mac in 2021!

Combine Getting Started Guide

Combine example with URLSession and assign value to a labels text

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Max Cobb

Max Cobb

Excited about all things Augmented Reality! Developer Evangelist at

More from Medium

Creating AR Tatooine from Star Wars with Swift and ARKit 5

Collection View of SwiftUI! Try arranging the images in LazyGrid

ARKit 911 — Image Tracking in Swift Playgrounds

Creating an iOS AR app using the AR Quick Look API