Content-testing tasks should start with problems users genuinely need to solve, rather than simply showing them an article and asking whether they like it. If the goal is to assess content quality and relevance, use open-ended information-seeking tasks to observe how participants explore, what questions arise, and whether the information meets their needs. Tasks should also reflect participants’ knowledge and circumstances. When running the session, allow time for reading and avoid questions that alter participants’ natural behavior.
Decide what you want to learn before choosing a task format
NN/g’s 2021 article on content testing distinguishes between two types of tasks: looking up library opening hours has a clear answer, while researching a topic does not necessarily have a single answer. If you want to understand whether content meets users’ needs, the latter lets researchers see how users explore, rather than simply whether they can find specified information.
- To understand information needs: observe what questions participants ask and where they look for answers.
- To understand whether information is presented appropriately: observe how they expect to access information and whether the website meets those expectations.
- To understand reading comprehension: ask participants to summarize what they have read in their own words, rather than simply asking, “Did you understand it?”
Recruit the right participants and match tasks to genuine needs
For content testing, it is especially important to recruit people whose mindsets, circumstances, and goals align with those of the target users. Tasks involving extensive reading and research depend even more on participants’ motivation and background knowledge. People for whom a task is irrelevant should not be asked to pretend they have that need.
For example, an investment website may serve both beginners and advanced readers, but someone interested in index funds may not want to research options. In a preliminary interview or at the start of the test, ask about participants’ investment experience, the tools they are familiar with, and the topics they want to learn about, then adjust the tasks accordingly. Preparing general tasks in advance is fine, but there is no need to force tasks that do not fit someone’s circumstances just to follow a script.
Describe the information need without prescribing a reading path
To test an article about investing during a market downturn, avoid simply opening the page and asking for opinions. You could adapt the source’s example into this task: “You are looking for investment advice for a market downturn. Use this website to research the questions you want answered.” The participant must genuinely have this need, rather than be asked to role-play as an investor.
This kind of task may lead participants to the target article while leaving room for independent exploration. If the study needs to uncover broader information needs, set aside some time for unrestricted web searches or browsing competing websites, rather than limiting the entire session to your own site.
Observe reading and comprehension without rushing to fill the silence
Open-ended tasks have less clearly defined endpoints, so tell participants at the outset to work at their own pace without worrying about time. Long silences during reading do not need to be filled immediately with questions; frequent interruptions disrupt concentration and change behavior.
If necessary, ask a neutral question along the way, such as “What are you looking for?” After they answer, let them continue. Once they have finished reading, ask them to summarize the main points in their own words. Explaining the content easily and accurately is a good sign of comprehension. If they need to go back and read it aloud word for word, they may not yet understand it clearly. Simply finishing the reading is not enough to show that they have understood the content.
Content-testing tasks: perspectives from across the web
Should content testing also include observing the layout?
Yes, especially when you want to check whether the layout can accommodate actual content. Test early layouts with real content and repeat these checks as you make revisions: whether fixed widths or line breaks cause crowding, whether different image and video aspect ratios work well, and whether horizontal elements make people mistakenly think they have reached the end of the page. For interactive content, also check that there is enough space around touch targets.
What can you ask after participants have read the content to understand how they perceive its tone?
Ask participants to imagine someone saying what they have just read to them: who would that person be, what would they look like or how would they behave, and what would they do for work? This indirect approach can help elicit descriptions of the writing’s tone. Wait until participants have finished reading and are ready to give feedback before asking, rather than interrupting frequently during reading and disrupting their concentration and behavior.
References
- Which Comes First? Layout or Content?www.nngroup.com · 2015-10-11T16:00:01+0000 — Discusses: Should content testing also include observing the layout?
- How to Test Content with Userswww.nngroup.com · 2021-02-07T17:00:00+0000 — Discusses: What can you ask after participants have read the content to understand how they perceive its tone?


