Previewing Spatial Audio on Apple AirPods
Created:While investigating how Apple applies their own HRTF and headtracking implementation on top of Dolby Atmos it became appearent that there are a few glaring issues and limitations. It also became clear that we can transcode all formats to playback on Apple devices without use of Dolby Atmos at all, making a much cleaner and direct pipeline if your target is only for headtracking as defined by Apple.
Apple seems to simply expect a video file with an EAC3
encoded audio track configured as 5.1(side)
and with a specific bitrate and other simple to implement codec settings.
It should be known that the 5.1(side)
then undergoes an arbritrary and frankly sloppy and low quality HRTF process by Apple that drastically shrinks the soundfield range, limits your divergence in the soundfield and results in a low quality and hard to mix for soundfield. Going into further detail about the soundfield limitations:
Limitations & Issues with Apple’s Spatial Implementation
These limitations are based on the date of this written post: 2021-08-12
- 5.1(side) = Left, Right, Center, LFE, Side-Left, Side-Right (L,R,C,LFE,SL,SR)
- The HRTF process force blends front/back aspects of the soundfield, if you turn around you will still hear the front bleed to 180 yaw orientation, also you will hear the rear bleed into the front. It seems Apple only wants to target a simulated “theatre” instead of opening this up to be applicable to many spatial audio concepts such as Spatial Music, Interactive Spatial Podcasts or any concept that doesn’t want the listener to pretend they are in a front-facing theatre (which is nearly all concepts using headtracking spatial audio)
- The HRTF process heavily colors the intended mix, adding an additional filtering and room modeling process on top of the intended mix also drastically limiting the usage of this technology
- The headtracking implementation has some glaring issues, tilting head rotates the yaw angle of the mix which is another limitation and technical mistake
Read more about early feedback on Apple Spatial Implementation here
How To Listen to Any Spatial Audio Format via Apple’s Spatial Implementation
As of version 1.5.10 of Mach1 Spatial System we have implementated a new output type
on the M1-Transcoder.app
it uses our m1-transcode
commandline to transcode to 5.1(side)
and then nicely generates or applies to video and transcodes the codec for direct AirDrop review on your Spatial-supported iOS device.
If you are starting with a Mach1 Spatial mix
- Open
M1-Transcode.app
- Input the Mach1 Spatial multichannel wav file
- Select
Apple Spatial 5.1-side (L,R,C,LFE,SL,SR)
Output Spatial Format
- [optional] Input a video file if you want (otherwise the app will auto-generate a video)
- Render
- Airdrop the output .mp4 file to your iOS device and play it natively with AirPod Pro or AirPod Max headphones connected
If you are starting with a different spatial audio format mix
- Use
m1-transcode
commandline tool to transcode from your input format to yourMach1 Spatial
- Open
M1-Transcode.app
- Input the Mach1 Spatial multichannel wav file
- Select
Apple Spatial 5.1-side (L,R,C,LFE,SL,SR)
Output Spatial Format
- [optional] Input a video file if you want (otherwise the app will auto-generate a video)
- Render
- Airdrop the output .mp4 file to your iOS device and play it natively with AirPod Pro or AirPod Max headphones connected