To understand the future of voice-first computing, you should consider accessibility on every platform; this is particularly true on Apple’s platform.
Computers are getting out of the way
Apple’s investments in accessibility are almost as old as the company itself. It opened its first office of disability in 1985.
Historically, Apple has always been ahead of the curve in terms of making accessible software, which it sees as a human right. This has won a great deal of recognition from key advocacy groups worldwide.
Fundamental to this work is an effort to build alternative user interfaces: the GUI, MultiTouch, and, of course, Apple’s next big user interface innovation: VoiceOver.
Apple’s work with VoiceOver has been iterative and revolutionary. It first appeared in the iPhone in 2009, took a big step forward in 2019 with Voice Control, and now has a new feature that’s even more deeply transformative: People Detection on the iPhone 12 Pro and Pro Max.
What is People Detection?
People Detection is a new accessibility feature that’s currently only available on high-end iPhones. It exploits Apple’s accessibility technologies, on-device artificial intelligence and the Neural Engine, People Occlusion in ARKit, VoiceOver, and the iPhone’s LiDAR scanner to help identify people using the iPhone camera and let you know how far away they are.
In use, you’ll hold your iPhone in front of you and the device will tell you when it sees a person, give you a description of them (“a child,” for example) and inform you as to how far away they are.
As you approach someone, People Detection will continue to explain the distance between you. It recognizes whether you are walking directly toward, or at an angle away from, another person.
How to enable People Detection
Available in iOS 14.2 or later, you enable People Detection in the iPhone’s Settings>Accessiblity section where you must enable Magnifier and VoiceOver. Once it’s enabled, you just need to open the Magnifier app, tap the People icon, and the app will use your camera to identify any people it sees in the view. It will provide a description of people it sees and tell you how far away they are from you.
For social distancing, People Detection also lets you set a distance threshold — so you’ll be warned by two audio tones if someone gets too close. It shares this information verbally, using haptics, or visually on the display. It can use all three alert forms at once, or in a combination that works for you — you may want haptics only, for example). If there are multiple people detected, it tells you that and lets you know the distance of the closest person.
AirPods users also get Spatial Audio alerts, so if a person is to the left, they’ll be alerted in their left ear, or to the right if on the right.
This BBC Click report has some excellent footage showing the feature in action:
What about identifying other things?
Apple’s People Detection technology can be seen as a proof-of-concept achievement. Apple doesn’t want this story to end here and has introduced APIs for developers that let them use the same technology to support detection apps for different tasks. Think about how solutions of this kind may help visually impaired users find bus stops, safe road crossings or stairs, for example.
Why this matters
Accessibility should be important to every enterprise just because its the right thing to do. But the idea that a smartphone can deliver real time information pertaining to the world around you using AI on the device this way is quite profound.
It opens up so many opportunities.
- Enterprises might add layers of useful intelligence to their consumer-focused apps – a paint manufacturer can create a color recognition app that works with this system to identify wall colors and wallpaper, for example.
- In business, it becomes possible to introduce augmented navigation tools to direct field service engineers in new locations, or to empower visually impaired staff in so many ways.
- The feature is also a huge step toward the development of voice-first user interfaces.
Ultimately, enterprise app developers should think about the technologies behind People Detection as it they demonstrate the huge importance of accessibility and voice control across Apple’s platform development plans, particularly around AR spectacles.
Please follow me on Twitter, or join me in the AppleHolic’s bar & grill and Apple Discussions groups on MeWe.
Copyright © 2020 IDG Communications, Inc.
Appreciating the persistence you put into your blog and detailed information you offer. It’s nice to come across a blog every once in a while that isn’t the same unwanted rehashed information. Excellent read! I’ve saved your site and I’m including your RSS feeds to my Google account.
690676 364854Ich kenne einige Leute, die aus Kanadakommen. Eines Tages werde ich auch dorthin reisen Lg Daniela 666076
83465 858982Nie and informative post, your every post worth atleast something. 67509
966610 251922Thanks for the auspicious writeup. It in fact used to be a leisure account it. Glance complicated to more delivered agreeable from you! Nevertheless, how can we be in contact? 30482
449029 961965Does your blog have a contact page? Im having a tough time locating it but, Id like to send you an e-mail. Ive got some suggestions for your weblog you may be interested in hearing. Either way, excellent internet site and I look forward to seeing it expand more than time. 260207
As I website possessor I believe the content matter here is rattling fantastic , appreciate it for your efforts. You should keep it up forever! Good Luck.
181261 711724Wow, cool post. Id like to write like this too – taking time and real effort to make a good article but I procrastinate too significantly and never appear to get started. Thanks though. 130250
Simply desire to say your article is as astounding. The clarity in your post is just spectacular and i can assume you are an expert on this subject. Fine with your permission allow me to grab your feed to keep updated with forthcoming post. Thanks a million and please continue the enjoyable work.
We’re a group of volunteers and opening a new scheme in our community. Your website provided us with valuable information to work on. You have done an impressive job and our whole community will be thankful to you.
205178 805981Significant other, this outstanding web site is fabolous, i merely adore it 327626
856257 124927educator, Sue. Although Sue had a list of discharge instructions in her hand, she paused and 374578
77117 622921Spot up for this write-up, I genuinely believe this web site requirements an excellent deal much more consideration. Ill likely to end up once again to read a great deal more, a lot of thanks for that data. 841995
611694 557941I basically must tell you which you have written an excellent and distinctive post that I really enjoyed reading. Im fascinated by how well you laid out your material and presented your views. Thank you. 156597
you’re really a good webmaster. The web site loading speed is incredible. It seems that you are doing any unique trick. Moreover, The contents are masterpiece. you’ve done a wonderful job on this topic!
I am curious to find out what blog platform you’re utilizing? I’m having some minor security issues with my latest site and I would like to find something more secure. Do you have any solutions?