How do you design content-testing tasks?

ProcrustesPR

Content-testing tasks should start with problems users genuinely need to solve, rather than simply showing them an article and asking whether they like it. If the goal is to assess content quality and relevance, use open-ended information-seeking tasks to observe how participants explore, what questions arise, and whether the information meets their needs. Tasks should also reflect participants’ knowledge and circumstances. When running the session, allow time for reading and avoid questions that alter participants’ natural behavior.

ProcrustesPRProcrustesPRHow do I write SEO articles that help my business?

Decide what you want to learn before choosing a task format

NN/g’s 2021 article on content testing distinguishes between two types of tasks: looking up library opening hours has a clear answer, while researching a topic does not necessarily have a single answer. If you want to understand whether content meets users’ needs, the latter lets researchers see how users explore, rather than simply whether they can find specified information.

  • To understand information needs: observe what questions participants ask and where they look for answers.
  • To understand whether information is presented appropriately: observe how they expect to access information and whether the website meets those expectations.
  • To understand reading comprehension: ask participants to summarize what they have read in their own words, rather than simply asking, “Did you understand it?”

Recruit the right participants and match tasks to genuine needs

For content testing, it is especially important to recruit people whose mindsets, circumstances, and goals align with those of the target users. Tasks involving extensive reading and research depend even more on participants’ motivation and background knowledge. People for whom a task is irrelevant should not be asked to pretend they have that need.

For example, an investment website may serve both beginners and advanced readers, but someone interested in index funds may not want to research options. In a preliminary interview or at the start of the test, ask about participants’ investment experience, the tools they are familiar with, and the topics they want to learn about, then adjust the tasks accordingly. Preparing general tasks in advance is fine, but there is no need to force tasks that do not fit someone’s circumstances just to follow a script.

Describe the information need without prescribing a reading path

To test an article about investing during a market downturn, avoid simply opening the page and asking for opinions. You could adapt the source’s example into this task: “You are looking for investment advice for a market downturn. Use this website to research the questions you want answered.” The participant must genuinely have this need, rather than be asked to role-play as an investor.

This kind of task may lead participants to the target article while leaving room for independent exploration. If the study needs to uncover broader information needs, set aside some time for unrestricted web searches or browsing competing websites, rather than limiting the entire session to your own site.

Observe reading and comprehension without rushing to fill the silence

Open-ended tasks have less clearly defined endpoints, so tell participants at the outset to work at their own pace without worrying about time. Long silences during reading do not need to be filled immediately with questions; frequent interruptions disrupt concentration and change behavior.

If necessary, ask a neutral question along the way, such as “What are you looking for?” After they answer, let them continue. Once they have finished reading, ask them to summarize the main points in their own words. Explaining the content easily and accurately is a good sign of comprehension. If they need to go back and read it aloud word for word, they may not yet understand it clearly. Simply finishing the reading is not enough to show that they have understood the content.

ProcrustesPRProcrustesPRCan AI-written articles work for SEO?

Content-testing tasks: perspectives from across the web

Should content testing also include observing the layout?

Yes, especially when you want to check whether the layout can accommodate actual content. Test early layouts with real content and repeat these checks as you make revisions: whether fixed widths or line breaks cause crowding, whether different image and video aspect ratios work well, and whether horizontal elements make people mistakenly think they have reached the end of the page. For interactive content, also check that there is enough space around touch targets.

What can you ask after participants have read the content to understand how they perceive its tone?

Ask participants to imagine someone saying what they have just read to them: who would that person be, what would they look like or how would they behave, and what would they do for work? This indirect approach can help elicit descriptions of the writing’s tone. Wait until participants have finished reading and are ready to give feedback before asking, rather than interrupting frequently during reading and disrupting their concentration and behavior.

ProcrustesPRHow do I write titles customers want to click?

References

  1. Which Comes First? Layout or Content?www.nngroup.com · 2015-10-11T16:00:01+0000 — Discusses: Should content testing also include observing the layout?
  2. How to Test Content with Userswww.nngroup.com · 2021-02-07T17:00:00+0000 — Discusses: What can you ask after participants have read the content to understand how they perceive its tone?

Related articles

How do I write SEO articles that help my business?Can AI-written articles work for SEO?How do I write titles customers want to click?Should I rewrite or update an old article that does not rank?Do SEO articles have to be long?Eight SEO essentials for beginners: Website contentHow to Set Up Heading Tags for SEO: Define Topics and Hierarchy Before Adding KeywordsHow should websites and product reviews be categorized and structured?
ProcrustesPR
ProcrustesPR