Science and technology

Sony Develops System to Convert Game Sounds into Visual Signals

25 October 20265 min read

Sony Develops System to Convert Game Sounds into Visual Signals
Sony files patent for system converting video game audio into visual cues for hearing-impaired players.

Sony Interactive Entertainment announced the development of a proposed technology aimed at helping deaf and hard-of-hearing players identify sounds within video games by converting these sounds into visual indicators on the screen, light signals, and vibrations. This development aims to enable players to identify sound sources and understand their nature during gameplay, thereby enhancing the gaming experience for this user group.

The technology news website Notebookcheck reported on Sunday that the company filed a patent application for a system that processes and classifies sounds based on their nature and expected impact on the player. This application was published in the United States on October 22 under number US 2026/0329526 A1, titled "System and Method for Audio Processing."

System Mechanism

The system analyzes sounds to determine whether they are alerts, dialogues, environmental effects, or sounds intended to evoke tension and surprise, then converts them into appropriate signals. These signals include displaying a warning symbol near an enemy attacking the player, showing a word representing a specific sound, or placing a graphical indicator to help identify the sound source. The system can also utilize sound characteristics such as intensity, pitch, and direction to change the shape and clarity of the visual indicators.

Advanced Technologies

The system determines the sound's location using spatial recordings or surround sound systems, helping the player know the direction from which the sound originated. The proposals include using directional lights in the DualSense controller for the PlayStation 5, along with different vibration patterns and visual signals on the screen. Each type of signal is linked to a specific type of sound to facilitate recognition.

Scope of Application

The application indicates the possibility of applying the technology to games that do not originally include accessibility tools, by analyzing audio files and adding data to help generate appropriate indicators without needing to modify the software of each game individually. The proposals also include creating a shared database of information related to game sounds and temporarily pausing certain scenes until the appropriate signal appears. This technology aims to provide a system that works on a broader scale, including games not originally designed to support accessibility features, unlike games such as Fortnite and The Last of Us Part II, which already offer limited visual options.

Source: Syrian Arab News Agency (SANA)

Comments (0)

0 / 600
No comments yet. Be the first to comment.