This invention introduces a method and system for interpreting hand gestures in mid-air using ultrasonic sensing. It enables users to control devices, such as changing images on a screen—simply by moving their hands in front of them, without touching or holding anything.

The innovation lies in combining real-time 3D gesture recognition with continuous visual feedback. By using ultrasonic transceivers to track the movement and position of the user’s hand, the system can detect gestures like swipes in front of the screen with high precision and low latency. The real-time visual response on the screen is not just functional, it guides the user intuitively, helping them understand how their gesture affects the interface and how to refine their motion.

Previous systems either lacked the spatial resolution or suffered from delay, leading to unnatural or frustrating user experiences. This solution ensures that the visual feedback is tightly synchronized with the hand motion, making the interaction natural, responsive, and easy to learn—even for new users.

The approach enables touchless interaction with stationary devices like tablets, monitors, or kiosks, offering both hygienic and intuitive user experiences, particularly useful in public or shared environments.