When should you use tree testing?

ProcrustesPR

Tree testing is useful when you want to check whether users can find specific information through an existing or proposed navigation hierarchy. It is particularly useful early in a redesign, after a card sorting study, and before writing content and designing layouts. It can also help you compare different structures. Participants look for resources within a simplified text hierarchy. The focus is on whether categories and labels are easy to understand, not on the experience of using the entire website.

ProcrustesPRProcrustesPRDoes my website need a speed score of 100?

Early in design: check the structure before starting production

You do not need a finished website prototype to run a tree test. You can start testing as soon as you have a hierarchical menu and tasks that ask participants to find resources. Even if the categories follow information architecture best practices, you cannot assume that users will understand the organizing logic.

Testing before writing content, designing layouts, or developing code lets you identify structural problems, revise the hierarchy, and evaluate alternatives. This reduces the need to repeatedly revise other parts of the design. Tasks should cover important products, services, or information related to business goals. They can also target categories you have concerns about.

After card sorting: check whether users can find content in the proposed structure

Card sorting asks participants to organize content into groups that make sense to them, so it is useful for exploring ways to organize information. Tree testing asks participants to find specific content within an established hierarchy, so it is useful for evaluating proposed structures. The two methods complement each other; neither replaces the other.

Card sorting usually does not produce a single, clearly correct structure, and different people may place the same content in different groups. Once you have developed candidate hierarchies, you should still test whether users can find what they need. For example, if a category’s name or location is disputed, you can ask participants to find related content and compare how different labels or locations perform, rather than treating the grouping results as the final menu.

During a redesign: establish a baseline and compare candidate structures

Early in a redesign, you can test the existing information architecture to identify categories where users get lost or confused and establish a baseline for later comparisons. If the team has several candidate structures, you can also test different trees using the same tasks.

  • To compare performance across structures: Quantitative testing can measure success rates, time spent finding information, and how direct users’ paths are, but it usually cannot explain the reasons behind their behavior in depth.
  • To understand why users make the wrong choice: Moderated qualitative testing allows you to ask follow-up questions about how participants interpret labels, but it is not suitable for collecting statistics such as success rates or task completion times.

When the question involves the full interface, do not rely on tree testing alone

Tree testing lacks contextual cues such as placement, color, images, and content, so its results cannot be equated directly with users’ performance on the full website. For example, mega menus can display multiple levels of categories at once, which may help users find content—but only if they enter the correct menu first.

Traditional usability testing can give you a fuller understanding of how visuals, layout, interactions, and content work together to affect how users find information. Task success rates on the final website are not guaranteed to be higher than in tree testing: good design may improve performance, while search features or menus that are difficult to use may make it worse.

ProcrustesPRProcrustesPREight SEO essentials for beginners: Website speed

Tree testing: perspectives from across the web

Is tree testing suitable for deciding whether the same content should appear in multiple categories?

Yes. You can observe whether participants look for the same resource in alternative categories to help determine whether cross-listing is needed. If a task has multiple correct locations, examine the final selections for each location rather than just the combined success rate. If a location is rarely selected, you can generally consider removing that cross-listing.

What should you do before formally collecting a large amount of test data?

You can start with a few moderated pilot sessions to check that the task wording is easy to understand and observe details that click logs or quantitative results may not readily reveal. For example, a pilot for one quantitative study found that some users avoided categories because their labels were too broad. This pattern did not appear in the quantitative results because the task order was randomized.

Can you gather additional feedback from users after an unmoderated tree test?

You can add a short post-test questionnaire that lists labels and asks participants to select those they found difficult to understand, followed by an open-ended question for other feedback. This can help uncover assumptions or misunderstandings that click logs may not reveal, but it only partially addresses the limitations: unmoderated testing still cannot capture the full context of behavior or allow immediate follow-up questions about an individual's actions.

ProcrustesPRWhat Ten Years of SEO Taught Me About Its Real Purpose

References

  1. Card Sorting vs. Tree Testingwww.nngroup.com · 2024-02-23T18:00:00+0000 — Source used in the article above.
  2. Tree Testing Part 2: Interpreting the Resultswww.nngroup.com · 2024-01-19T17:00:00+0000 — Discusses: Is tree testing suitable for deciding whether the same content should appear in multiple categories?
  3. Tree Testing: Evaluate Menu Labels and Categorieswww.nngroup.com · 2023-08-06T18:00:00+0000 — Discusses: Is tree testing suitable for deciding whether the same content should appear in multiple categories?; What should you do before formally collecting a large amount of test data?

Related articles

Does my website need a speed score of 100?Eight SEO essentials for beginners: Website speedWhat Ten Years of SEO Taught Me About Its Real PurposeHow Do RWD and AWD Work, and Which Should You Choose for Your Website?What are the benefits and development challenges of SPAs?How do UTF-8 and Big5 differ in their effects on search rankings and user experience?What are single-page websites best suited for, and what are their pros and cons?Keep different topics on one site or split them up? Start with audience overlap and maintenance capacity
ProcrustesPR
ProcrustesPR