A Deep Learning Approach for Nystagmus Recognition in RGB Videos

Recommended citation: Giacomo Nunziati, Andrea Porri, Paolo Andreini, Simone Bonechi, Monica Bianchini, Rudi Pecci, Mattia Ronchetti, Franco Scarselli, Simone Vanni. A Deep Learning Approach for Nystagmus Recognition in RGB Videos. 2025 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE) (pp. 1331-1336). IEEE. 2025. (BibTex)

Abstract

Nystagmus is a condition characterized by involuntary, rapid and repetitive movement of the eyes, mainly caused by a dysfunction of the peripheral vestibular system located in the inner ear. It may also arise from the dysfunction of brain areas dedicated to the control of equilibrium and of the visual system. Precisely recognizing nystagmus may help in rapidly differentiating benign from potentially life-threatening diseases. In this paper, we propose a method, based on eye tracking, to easily process RGB videos captured with widely used devices (like smartphones and tablets) to recognize horizontal nystagmus and its direction. The proposed pipeline is designed to work in flexible conditions, without requiring specific recording configurations. We train and evaluate the system on real videos and report an AUROC of 88.7% for nystagmus detection and 76.5% for direction classification. These results support the feasibility of using consumer-grade video data for accurate and automatic screening of nystagmus

You can find the full paper here