In Satya Nadella (Satya Nadella) 's first autobiography, Refresh, the current Microsoft chief executive admitted that one of the important sources of empathy (empathy) was because his first son had cerebral paralysis and lifelong disability as a result of premature delivery. That's one of the reasons Microsoft is pushing Microsoft Adaptive technology so that people with disabilities can live in a fairer environment.
In this patent, the term "sensory substitution" is highlighted, which means the concept of converting some kinds of human sensory signals or modes into another mode. For example, the first mode can cover visual signals, and the second mode can include audio signals. Other modes include tactile based signals, temperature, vestibular signals, taste, smell and other signals that can be sensed by the sensory organs of organisms
Described in the Microsoft patent:
In the general overview, Fig.1 diagram is an example and method of sensory substitution. Among them, the first player 110 with visual impairment is hitting the ball. The second player 120 (with normal vision) is pitching to the first player 110.
In order to illustrate the movement of the ball over the distance between the first player 110 and the second player 120, the ball 150 is shown in the snapshot as it represents the movement of the ball over time with a dotted line. In addition, for illustrative purposes only, waveform 160 is displayed above the described stroke or flight up square of ball 150.
If the ball itself is making a sound (such as a beep, whistle, Chi, music or any other basically continuous sound) as well as a repetitive sound, the sound appears to the first player 110 to move up as the frequency approaches. The waveform 160 represents a possible shift in the frequency of the sound associated with the ball 150 as the ball moves toward the first player 110, as the first player 110 may hear.
It can be understood that even in noisy environment or background, the auditory system can usually deal with complex and rapidly changing sound patterns, and this change is easy to identify.
Although the idea seems fanciful, Microsoft has shown its commitment to creating inclusive technology, so in the end, we may see this special helmet finally put on the market. The complete patent can be seen here.