Eye-movements in reading: a teaser

March 31, 2016
Tags: -linguistics
Length: long

I am currently involved in an eye-tracking study investigating some aspects of reading in Arabic. Eye-tracking is a research method in which a person’s eyes movements are recorded while he or she performs some sort of task. By analyzing the eye-movement it is possible to see exactly were that person is looking at a certain point in time, and based on this data one can draw conclusions about mental activities during that task.

One of the areas where eye-tracking technology has had a major impact is in reading research. For adult, proficient readers, reading is a highly automatic activity, to the degree that we are not aware exactly of what we are doing when we read. You sometimes get the feeling that words are beamed straight into your brain without even passing the eye. Only occasionally do we have to stop to decipher the odd word or backtrack to reread some portion of the text. Eye-tracking presents a way to get very precise measurements of what it is we are doing when we read, how the eyes move, whereto, and how quickly, and, by extension, to show with great detail how we process texts when reading.

Most modern eye-tracking equipment works by filming they eye whilst shining infrared light on it. It records the position of the pupil and the position of the reflection of the infrared light in the eye. From that information the computer calculates the angle of the eye-ball at any given time. From this information it is possible to tell what point the person is looking at on a surface in front of them. This surface is typically a computer screen.

One of the things we are usually not aware of when reading is that the eye moves in quick, step wise motions. We typically have the sensation when we read of the eye moving smoothly across the line of text, but in fact it moves in a series very quick movements and then stops for a little while to take in information. During the movements, called saccades, we are in effect blind since the eye moves so quickly that we cannot perceive anything. The movement only serves to move the eye to another part of the text where we make the next brief stop, called fixation, during which the eye takes in information before jumping to another location further down the line of text. The brain then smooths out these pieces of information so that we experience it as a smooth motion.

This is illustrated in the video below. It shows my eye-movements, that is, where I am looking, in real time when I read a pdf with an article in my field that I hadn’t read before. Each line in the video is a saccade and each circle a fixation. (The data has been cleaned from noise and some other effects. More on this below.) The particular equipment used to record this data is not the most accurate and the text on the screen is very small, so the recorded movements are a bit off. It is for example difficult to see exactly which line I am reading at any given time. But you can clearly see the step wise motions of reading. Notice also how I move down to read the footnotes, and then also for some reason check out the page header before moving on.

The video below shows me slowly and carefully reading a line of Arabic text. As you can see I read this sentence fairly slowly. This data was recorded with larger text and with equipment giving much more accurate data. The eye-tracker used here records the position of the eye once every millisecond. It was also recorded with my chin and forehead resting on a stand to ovoid head movement that might disturb the recording. The green circle in the video shows how my eye moves. (Only one eye is normally recorded in eye-tracking studied since the two eyes move more or less in parallel anyway.)

Even if I am reading very slowly it is a bit difficult to follow. So instead we can draw all the recorded eye-positions (1000 per second) on the line of text. In the image below they are shown as blue dots.

Raw eye-movement on a line of Arabic text

You can see the clusters of blue dots on each word, with a squiggly line between each cluster. Each cluster is a fixation, where I keep my eye more or less steady for a short period, and the lines between them are saccades. The strange long downward movement from the last, leftmost word in the sentence is me closing my eye. As the eyelid moves down it covers part of the pupil so that the eye-tracker only sees the lower part of it and calculates its center to be further down, thus recording a downward movement of the eye.

Now, we know that the eye moves in saccades (quick motions during which we are blind) and fixations (periods of relative stillness between saccades). So we can say that all recorded positions where the eye does not move much, clusters of blue in the image above, are fixations, and that quick movements are cascades. We then get something that can be illustrated as in the image below.

Fixations and saccades on a line of Arabic text

The orange lines in this image represent saccades. The light blue circles represent fixations with numbers indicating the duration of these fixations in milliseconds. You can see, for example, that for longer words, such as the second and the third word from the right, there are long fixations of more than half a second. On the two instances of the short word (‏في‏) ‘in’ (fifth and tenth from the right) the fixations are much shorter. When you read normally, these kinds of small function words are normally completely skipped and are not fixated at all. We process them in our peripheral vision when fixating other words. Notice in the video above of me fairly quickly reading an article how there are only so many fixations (circles in the video) on each line, much fewer than the number of words on each line. Many words are skipped.

Thus, with modern eye-tracking methods you can get a very precise description of how the eyes move when reading a certain piece of text. If we do this on a number of people and average the results we can see what words are difficult, where people have to backtrack to reread, or how the activity of reading differs between different kinds of readers, different kinds of texts, or between languages with different writing systems.