Eye and head motion tracker system for computer applications


Yılmaz D., Balcı M. E., Dilmeç A. H., Bölek Ö.

1st International Conference on Innovative Academic Studies, Konya, Türkiye, 10 - 13 Eylül 2022, ss.1-4

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Basıldığı Şehir: Konya
  • Basıldığı Ülke: Türkiye
  • Sayfa Sayıları: ss.1-4
  • Gazi Üniversitesi Adresli: Evet

Özet

The use of head/eye motions in applications requiring control is an easy form of communication method that can be used by individuals who have problems using their hands and who have lost all or part of their motor skills. A significant number of users, especially disabled individuals, are unable to use today's WIMP (Windows, Icons, Menus, and Pointers) style Graphical User Interfaces (GUIs). In this study, a system design that is sensitive to the eye and head movements is explained for people with disabilities to interact with the computer with mouse control on the computer screen. Eye movements and head movements were detected based on camera, image processing, and Convolutional Neural Network (CNN). The cursor of the computer is directed by head movements, and commands are given by eye movements. Tests on the system, which is designed to be easy to use and low cost, are shown that the system works as effectively. As a result, the designed system can improve the quality of life of people with physical disabilities by increasing the capacity for independent computer use, both for entertainment and communications.