Skip to content

iOS 13 + ARKit 3 + Body Tracking = An invisible AR guitar that plays different sounds when strummed based on the position of the left hand along the invisible guitar's neck.

Notifications You must be signed in to change notification settings

robomex/ARKit-3-Body-Tracking-AR-Guitar-Demo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 

Repository files navigation

ARKit 3 Body Tracking: AR Guitar Demo

iOS 13 + ARKit 3 + Body Tracking = An invisible AR guitar that plays different sounds when strummed based on the position of the left hand along the invisible guitar's neck.

This project was a quick dive into RealityKit and ARKit 3's Body Tracking (i.e. ARBodyTrackingConfiguration) to explore body-based controls.

ARKit 3 Body Tracking AR Guitar Demo Gif

To watch the video with sound, check it out on Twitter.

I wrote more about building this demo and my initial thoughts on RealityKit.

To Play the AR Guitar

  1. Run the app and point it at a person
  2. Hold the left hand up along the invisible guitar's neck
  3. Strum with the right hand
  4. Move the left hand to select different sounds
  5. Strum with the right hand again

Credit to https://freesound.org for the great free sounds.

About

iOS 13 + ARKit 3 + Body Tracking = An invisible AR guitar that plays different sounds when strummed based on the position of the left hand along the invisible guitar's neck.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages