Apple has filed for a patent on technology that has the potential to allow Siri to understand lip movements using motion cues. Initially proposed in January of this year, this innovative idea allows Siri to theoretically recognize mouth and head movements to improve accuracy and minimize the need for continuous microphone use.
Apple’s Siri will now understand motion-based voice recognition | Patents filed by Apple (how will it work?)
Revolutionizing voice commands
As described in a recent AppleInsider report, the recently disclosed patent application, titled “Keyword Detection Using Motion Sensing,” essentially operates according to the implications of its name. When obtaining data from a motion sensor, the system evaluates whether any element of the motion data matches the reference data and actively searches for particular phrases or words.
The patent illustrations make explicit reference to vocal commands like “Hey Siri,” “Skip,” and “Next Song,” and discuss how these commands could be enhanced by motion detection. Today’s voice recognition systems, such as Siri, frequently suffer from reduced accuracy due to factors such as background noise, and also require significant battery and processing resources.
However, the novel system would take advantage of existing motion sensors, such as gyroscopes or accelerometers, to determine whether movements of the mouth, neck, and head indicate human speech.
Exploring Apple’s proprietary motion detection for improved Siri and more
According to documentation, it possesses the ability to identify subtle disturbances in facial muscle activity, head movements, or vibrations. If the motion detection happens fast enough, it could allow Siri to wake up the microphone in a timely manner to capture the remaining part of the statement.
Although Apple has not indicated its intentions regarding extending the new system to devices other than Siri, the motion sensor technology could be integrated into other Apple products, such as the upcoming mixed reality headset, Vision Pro or AirPods.
With Apple regularly filing numerous patents on a yearly basis, with many of them not materializing in consumer products, it remains uncertain whether the tech giant will eventually incorporate motion-based lip reading into its next products.
