Eye tracking enabling free-hand drawing
This paper is an introduction paper for a software I developed. The software is using eye tracking technology and enabling the free-hand drawing which is accessible for disabled people. The contents I need to write is:
- Introduction (700-800 words )
The first or second sentence introduces the significance of the eye gaze interaction and importance for accessibility of human computer. There are many applications for word typing, interface control, and computer games supporting gaze interaction . For the applications that do not support eye tracking technology, gaze interaction can be realized by controlling the applications through the commercial eye tracking program like Tobii dynavix, optikey and ..< refer some examples>.
Whether the application is directly supporting the eye tracking technology or indirectly controlling through the eye tracking program, the dominant gaze control is dwell click, which is to activate the command by gazing an element in a time lapse . Therefore, most gaze interaction research focuses on solving problems in dwell click process, such as target selection, click accuracy, Midas problem and precise selection of small targets. Mouse click events can be emulated by dwell clicking on an interface element. it is problematic to conduct the click and drag Mouse events Five gase interaction. Unfortunately Other mouse events, especially mouse click and drag, is challenging for gaze control. There is no research to the best of our knowledge that solves the emulation of the click and drag mouse event. And there is no way for gaze interaction to implement the application which requires continuous input of mouse signal, such as drawing.
At present, there is no sophisticated gaze-based drawing applications. However, indirect control of existing drawing software (such as Photoshop) by eye tracking program lead to many problems. The accuracy of gaze interaction is limited due to inherent hardware(eye trackers) error and involuntary eye movement error (such as saccade and blinks). There is no solution to control the brush cursor accurately and with high fidelity in realtime in the drawing process. Furthermore, human eyeballs can not engage in dual and mutually exclusive physiological activities at the same time, that is, eyes can not observe (fixation) while controlling the brush (saccade). In addition, Photoshop and other sophisticated drawing software contains compiling, small, and multi- hierarchy menus and shortcut keys, as they are designed for mouse and keyboard, not gaze-based. The efficiency and user experience of indirect control through eye tracking program is very low.
We propose an novel gaze control free-hand drawing application, which can precisely and efficiently control the trajectory of the brush to achieve high-fidelity illustration. The application interface fully conforms to the design principles of gaze interaction, with higher interactive efficiency and feasibility. In this application, we propose a set of new gaze control mechanisms, which can conform to the physiological habits of human eyes, and reduce the interferences from hardware error and involuntary eye movement, and achieve accurate input control. In addition, this paper systematically studies the performance of the software and the user experience of disabled people. The contributions of this paper are as follows. 1. An efficient and concise gaze-based interface. It fills the current gap of the usability of drawing software for gaze interaction. 2. We are the first to propose three novel eye control mechanisms, initially solve the problem that gaze control can not accurately click and drag. 3. The application uses unimodal gaze control, so it has universal accessibility (for example, convenient for people with high physical disability), and can be easy extended to the field of multimodal control. 4. We obtain the user experience data of the disabled people to evaluate the usability of the software.
- Related Work (500-600 words)
The first drawing software is EagleEye. (But what are the problems with this app? Free-hand (or free eye drawing) drawing cannot control the inputs.)
Introducing the previous relevant eye tracking drawing research after EagleEye and discuss on their disadvantages. To emphaze the fact that all the existing eye tracking software don’t use free hand drawing any more as the emulation of click and drag is unsolved. All the application in the literature after EagleEye used preset geometry to piece together, because there is no way to solve the problem of click drag control. But this way of painting has great limitations for creation, and can not meet the needs a high graphical creation. Moreover, the interfaces of these eye tracker drawing software were very old, which is not suitable for the current display device standards. For example the resolution and the aspect ratio…
In recent years, the research of eye tracking drawing includes: using robot arm to interpret the data of eye scanning a picture’s trajectory , so as to draw a graph, but this is not painting creation. It’s just scanning and replicating pictures. There is an article about multimodal eye movement interaction to create layout design< Creed, C., Frutos-Pascual, M., & Williams, I. (2020, April). Multimodal Gaze Interaction for Creative Design. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1-13).>. This article proposes an interface design suitable for eye movement interaction. The design content is also limited to the design elements provided in the program, and does not have the function of free hand drawing and sketching. In addition, this paper adopts the multimodal interaction of mechanical control and eye gaze, which is not friendly to people with extreme disabilities.
(Searching the lastest paper for eye tracking drawing, gaze control drawing…in the year after 2017.)
Type of service: Academic paper writing
Type of Assignment: Research paper
Subject: IT & Technology
Number of Sources: 20
Academic level: GCSE / A Level
Paper format: MLA
Line Spacing: Single
Language Style: UK English