As content becomes more difficult, reading on a phone may become more demanding without necessarily leading to lower comprehension scores. A research summary published by NN/g in 2016 reported that reading speeds for easy articles were roughly the same on phones and computers, while difficult articles were read more slowly on phones. In other words, similar comprehension does not mean reading takes the same amount of time or effort. Whether extremely difficult content leads to poorer comprehension on phones remains uncertain.
In the study, “difficulty” included both length and reading level
The study classified article difficulty using both word count and the Flesch-Kincaid reading grade level. Articles used in the final two rounds of the study had the following average word counts and reading levels:
- Easy articles: approximately 404 words, at an eighth-grade reading level.
- Difficult articles: approximately 988 words, at a twelfth-grade reading level.
All articles used the same simple HTML design template. These word counts are not Chinese character counts, and the grade levels indicate reading difficulty as measured by that formula. The results therefore cannot be reduced to “articles become hard to read on phones above a certain word count.” Nor can these comparisons alone isolate how much of the effect came from length versus language difficulty.
Similar comprehension may still take more time
The in-person study recorded reading time as well as comprehension scores. Because article lengths varied, the researchers divided reading time by word count to compare the average time spent per word, rather than looking only at the time needed to finish an entire article.
The results showed similar reading speeds on the two devices for easy articles. For difficult articles, readers spent about 30 milliseconds more per word on phones than on computers, on average. The interaction between device and article difficulty in the reading-time analysis was statistically significant (p=0.01). This was an average result across study participants, not a fixed increase for every reader or every article.
Understanding may require slowing down or rereading
The authors explained this pattern as a “speed–accuracy tradeoff”: when reading difficult articles, phone readers may struggle to sustain a higher working-memory load and therefore slow down to maintain similar comprehension. They might:
- Read more carefully and try to remember information that may be needed later.
- Reread certain passages to recover information needed for comprehension.
This is the authors’ possible explanation of the results, not proof that every reader behaved this way. Comprehension scores and reading time therefore need to be considered separately: similar performance on questions may still come with longer reading times.
Difficult does not necessarily mean incomprehensible on a phone
Readers in the study had lower comprehension scores for difficult articles than for easy ones, but this does not mean they necessarily understood less on phones than on computers. The comprehension-score analysis showed that phones’ small initial advantage diminished for difficult articles, but this interaction between device and article difficulty was only marginally significant (p=0.10). The authors noted that the effect would first need to be confirmed and shown to extend to content more difficult than the study covered. Only then could it support the inference that extremely difficult content is harder to understand on phones.
Content difficulty and reading on a phone: common questions
Are comprehension scores alone enough to assess how easy difficult text is to read on a phone?
No. Even when comprehension is similar on phones and computers, readers may need more time on a phone to achieve similar performance. The study’s authors offered a speed–accuracy tradeoff as an explanation: readers may read more carefully or go back and reread. This is a possible explanation of the results, not proof that every participant did so.
Can shortening an article eliminate reading difficulties on phones?
This study does not establish that shortening an article alone can eliminate reading difficulties on phones. It considered both length and reading level when classifying article difficulty, and its difficult articles were also longer on average than its easy articles. The observed differences in comprehension and reading speed therefore cannot be attributed to length alone.
Can we predict phone readers’ comprehension when articles are more difficult than the study materials?
Not with certainty at this point. In the study, phones’ initially small advantage in comprehension scores diminished for difficult articles, but this interaction between difficulty and device was only marginally significant. The authors suggested that extremely difficult content might be harder to understand on phones. That possibility depends on first confirming that the observed effect is real and that it extends to more difficult content beyond what the study covered.
References
- Reading Content on Mobile Deviceswww.nngroup.com · 2016-12-11T17:00:01+0000 — Discusses: Are comprehension scores alone enough to assess how easy difficult text is to read on a phone?; Can shortening an article eliminate reading difficulties on phones?


