New Sony Patent Could Use AI and a Camera Pointed at Your Fingers to Work Out What Button You’ll Press Next

Sony's Novel Approach to Reducing Gaming Latency: An AI-Powered Solution

A recently published Sony patent (WO2025010132, "TIMED INPUT/ACTION RELEASE") reveals a potential game-changer in reducing input latency. This innovative approach leverages AI and additional sensors to predict player inputs, thereby minimizing the delay between action and on-screen response. This is particularly relevant given the increased latency often associated with advanced graphics technologies like frame generation, even though they boost frame rates.

Sony's PlayStation 5 Pro already features PlayStation Spectral Super Resolution (PSSR), an upscaler. However, higher frame rates don't always equate to improved responsiveness. Competitors AMD and Nvidia have addressed this with Radeon Anti-Lag and Nvidia Reflex respectively, and now Sony appears poised to enter the fray with its own solution.

The patent details a system employing a machine learning (ML) model to anticipate the player's next input. This prediction is enhanced by external sensors, potentially a camera observing the controller, to detect impending button presses. The patent explicitly mentions using "camera input as an input to a machine learning (ML) model." Alternatively, the sensor could be integrated directly into the controller buttons themselves, possibly utilizing analog input – a technology Sony has championed in the past.

While the exact implementation in a future PlayStation console (like the hypothetical PlayStation 6) remains uncertain – patents rarely translate directly into final products – the patent strongly suggests Sony's commitment to minimizing latency without sacrificing responsiveness. This is especially crucial given the rising popularity of frame generation technologies such as FSR 3 and DLSS 3, which inherently introduce latency.

The benefits of this technology would be most apparent in fast-paced games, like competitive shooters, where high frame rates and low latency are paramount. The practical application of this patent in future hardware, however, remains to be seen.