Spatial audio (AR audio)

Spatial audio makes sound seem to come from a specific place around the listener. In AR, audio can be attached to a virtual object so it sounds like it comes from the artwork, or geofenced to an area so music, narration or a sound piece plays only when visitors are there.

Also known as: AR audio, geofenced audio, 3D audio, positional audio, sound art, audio-reactive AR

Video: Crafting an AR audio reactive experience using the illust. AR Creator Studio
Crafting an AR audio reactive experience using the illust. AR Creator Studio

How it works

Creators add an audio file to a scene and decide where it plays: tethered to the artwork, so it seems to come from the piece, or across a radius around the location, so it starts as visitors walk in. Some AR tools also drive animation from the music, so the piece pulses with the beat.

How it works in illust

illust's Audio module takes MP3 files, supports a discover radius around a placement, and includes an audio-reactive option that scales the piece with the bass. Video with its own sound plays automatically.

Explore AR Studio

Key facts

  • illust's Audio module takes an MP3 as the audio source and has an audio discover radius; videos that carry their own sound play automatically (illust Studio docs: Audio).
  • A bass-notes option animates the piece, so it bounces in size and scale when the bass drops (illust Studio docs: Audio).
  • In illust, a scene's audio track can be geofenced or tethered directly to the AR scene (illust AR Studio).
  • On the web, the Web Audio API's PannerNode describes where a sound source sits in a simulated 3D space relative to the listener (MDN Web Docs).

FAQ

Do visitors need headphones?

No, but headphones make spatial and narrated pieces much better.

Can the artwork move to the music?

Yes. illust's bass-notes option makes the piece bounce in size and scale when the bass drops, so it pulses with the beat.

Related terms

More in this topic

Adobe Aero

Adobe Aero was Adobe’s free AR authoring app for iOS, Android and desktop, launched at Adobe MAX 2019 so designers could build interactive AR scenes.

AR art (augmented reality art)

AR art is artwork made to be experienced through augmented reality: digital sculptures, animations, sound and video that appear in real places, on physical artworks or on people, seen through a phone or glasses.

AR art exhibition

An AR art exhibition presents artworks in augmented reality, placed in a gallery, park, street or across a city, which visitors view through their phones.