Apple introduces new cognitive and assistive features to enable anyone to use the product smoothly

Apple introduces new features for easier use of their products

【PhoneAuto News】On May 16th, PhoneAuto learned from Apple officials that today Apple has showcased software accessibility features designed for cognitive, visual, auditory and physical activity abilities, as well as innovative tools designed for people with speech impairments or at risk of losing their ability to speak. These new features use advanced hardware and software technologies such as device-side machine learning to protect user privacy and continue Apple’s commitment to making products that everyone can use smoothly.

Apple

Apple stated that it has developed various accessibility features in deep cooperation with community organizations representing various disabled users, which have a true impact on people’s lives. Starting later this year, cognitive impairment users will be able to use Assistive Access to independently use iPhones and iPads more easily; speech-impaired users will be able to use Live Speech to convert typed text into speech output for conversation during calls and chats; and users at risk of losing their ability to speak can use Personal Voice to create synthetic voices that sound similar to their own voices for communication with family and friends. For blind or low-vision users, the magnifier detection mode provides Point and Speak functionality, which can recognize the text pointed to by the user and read it aloud, helping them better understand and use physical objects such as home appliances.

“At Apple, we always believe that technology that serves everyone is the best technology.” Apple CEO Tim Cook said, “Today, we are pleased to share outstanding new features that continue our long-standing efforts to create accessible technology, giving everyone the opportunity to unleash their creativity, communicate and do what they love.”

• Time moves forward, love remains unchanged and Huawei’s smart door lock unlocks motherly love on Mother’s Day
• Breaking News! China Mobile completes 5G mobile terminal direct connection satellite laboratory verification
• Expected to be released on May 29th! Honor 90 series high-definition photos exposed, playing with color?

“Apple has integrated the concept of accessibility into every aspect of our work.” Sarah Herrlinger, Apple’s senior policy and action manager for global accessibility, said, “Each step in the design of these groundbreaking technologies is based on feedback from members of the disability community and aims to support users’ diverse needs in new ways and help people communicate.”

It is reported that Assistive Access uses innovative design and integrates the basic functions of iPhone’s camera, photo, music, phone, and message apps, including a customized experience for phone and Facetime, and combines message, camera, photo, and music apps into a separate Calls app. This feature provides a unique interface with high contrast keys and large text labels, as well as various tools to help trusted caregivers customize the user experience for their care recipients.

Assistive Access function

The Live Speech and Personal Voice functions enable barrier-free voice communication. Live Speech is designed to support millions of people worldwide who have lost or are gradually losing their language ability. With the Live Speech function of iPhone, iPad, and Mac, users can type what they want to say when making a phone call, FaceTime call, or face-to-face communication, and the device will read it out loud. Users can also save commonly used phrases to express their opinions quickly when talking with family, friends, and colleagues.

Live Speech function demonstration

Personal Voice is a simple and secure function that helps users who are about to lose their speech to create a voice that sounds similar to their own. Users can use an iPhone or iPad to record 15 minutes of audio, read randomly generated text prompts, and create a Personal Voice. This language assistance function uses device-side machine learning technology to ensure user information is private and secure, and seamlessly integrates with Live Speech, allowing users to speak through Personal Voice when communicating with loved ones.

Personal Voice function

In addition to the above assistive functions for people with speech disabilities, Apple has also launched the Point and Speak function for blind or low-vision users through the detector mode of magnifier. This function helps visually impaired users understand and use physical objects with multiple text labels more easily. For example, when using household appliances such as microwaves, Point and Speak can combine the content input by the camera app and laser scanner with device-side machine learning, and read out the text on each button as the user moves their finger over the keypad. In addition, Point and Speak can collaborate with audio descriptions, as well as other magnifier functions such as face detection, door detection, and image description, to help visually impaired users better use other devices.

Point and Speak Functionality

In order to provide better accessibility, Apple has optimized many aspects such as hearing aid connectivity, voice control, and browser mobile element image adjustment. To welcome Global Accessibility Awareness Day, Apple will launch new features, curated collections, and more content this week. They have also invited three leaders from the disability community to share their life experiences and discuss how Augmentative and Alternative Communication (AAC) apps have made a significant impact on their lives.

We will continue to update Phone&Auto; if you have any questions or suggestions, please contact us!