Card sort analysis: how to read the results (with a worked example)

Running a card sort is the easy part. The real value is in the analysis — turning dozens of participants' groupings into a defensible information architecture instead of a gut-feel guess. This guide explains every output that matters, shows you a worked example with real numbers, and gives you a repeatable process for going from data to IA.

What a card sort gives you

In a card sort, participants group your content items ("cards") into categories — either open (they name their own groups) or closed (they sort into your predefined categories). Across many participants, two kinds of pattern emerge: what belongs together (grouping) and what people call it (labels). Good analysis extracts both.

The three analyses that matter

1. The similarity matrix (start here)

The similarity matrix shows, for every pair of cards, the percentage of participants who put them in the same group. It's the single most useful card-sort output because it's built directly from agreement — no interpretation required.

Worked example. Suppose 20 participants sorted a set of e-commerce account cards. A slice of the matrix looks like this (each cell = % who grouped that pair together):

Update card Invoices Reset pwd 2FA
Update card 90% 15% 10%
Invoices 90% 20% 10%
Reset pwd 15% 20% 85%
2FA 10% 10% 85%

Read it as a heatmap. Two obvious clusters jump out: Update card + Invoices (90% — a "Billing" group) and Reset password + 2FA (85% — a "Security/Login" group). The cross-pairs (Update card × Reset pwd = 15%) are low, confirming the two clusters are genuinely distinct. That's your IA skeleton, straight from the data.

How to read thresholds:

2. Suggested clusters / dendrogram

A dendrogram (or agreement-based cluster list) turns the matrix into candidate groups by linking cards that exceed an agreement threshold. Picture a tree: cards that were grouped together most often join at the bottom (high agreement); weaker links join higher up. Where you "cut" the dendrogram determines how many categories you get.

The dendrogram answers "if I had to draw category boundaries, where would they naturally fall?" Use it as a proposal, then apply judgment — it's a starting point, not a verdict.

3. Category labels (open sorts)

In an open sort, the names participants give their groups are gold. Cluster the label language: if twelve of twenty people call the billing cluster "Billing" or "Payments," you've found both the category and its label — in users' own words. This is the part spreadsheets miss and that most teams under-use.

The standardization step (don't skip)

In open sorts, people name the same group differently — "Payments," "Billing," "Money stuff," "$$." Before you count labels, standardize them into canonical buckets so your label analysis isn't fragmented across synonyms. Then the frequency count becomes meaningful ("14/20 named this group some variant of Billing").

Turning analysis into an IA (repeatable process)

  1. Start from the similarity matrix — identify the tight clusters (high mutual agreement).
  2. Cross-check with the dendrogram / suggested clusters to see where boundaries naturally fall and how many categories the data supports.
  3. Name each group using participants' own standardized label language from open sorts.
  4. List the ambiguous cards — items that landed in many different groups. For each, decide: relabel it, place it deliberately, or make it a cross-link / persistent element.
  5. Draft the IA and validate it with a tree test before building.

Reading ambiguous cards (this is where the insight is)

Cards that scatter across many groups aren't noise — they're your clearest signal that something is unclear. Two common patterns:

How many participants do you need for reliable analysis?

Card sorting stabilizes faster than you'd expect. 15–20 participants per audience typically surfaces the major clusters; the similarity percentages keep sharpening as you add more, but the big groups rarely change after ~15. Go to 30 for diverse or high-stakes audiences. If your matrix is full of 40–60% values with no clear clusters, that's usually a content problem (genuinely ambiguous items), not a sample-size problem.

Common analysis mistakes

Analyze a card sort free

ResearchRocket's card sorting includes a cross-participant similarity matrix (shaded by agreement) and agreement-based suggested clusters automatically — no exporting to a spreadsheet, no manual matrix-building. It's part of an all-in-one platform, so you can card sort, tree test, and analyze in one place. Try the free card sorting tool.

FAQ

How do you analyze a card sort? Start with the similarity matrix (pairwise agreement between cards), confirm boundaries with the dendrogram / suggested clusters, standardize and count participants' group labels from open sorts, flag ambiguous cards for deliberate decisions, then validate the resulting IA with a tree test.

What is a similarity matrix in card sorting? A grid showing, for each pair of cards, the percentage of participants who grouped them together — the clearest, least subjective view of what belongs with what. Values above ~70% indicate strong pairings.

What is a dendrogram in card sorting? A tree diagram that links cards by how often they were grouped together; cards with high agreement join low on the tree. Where you "cut" it determines how many categories your IA has.

How many participants do I need for a card sort? Around 15–20 per audience surfaces the major patterns; 30 for diverse audiences. More participants mainly sharpen the agreement percentages rather than changing the big clusters.

What do I do with cards that don't fit any group? If a card splits evenly between two groups, place it in the primary and cross-link. If it scatters everywhere, it's probably an action (like "Contact support"), not a topic — pull it out as a persistent element.

Do I have to build the similarity matrix by hand? No — a good card sorting tool generates it automatically. ResearchRocket includes the similarity matrix and suggested clusters built in.

Is there a free card sorting tool with analysis? Yes — ResearchRocket offers a free card sort with a built-in similarity matrix and suggested clusters, no account required.


Analyze a card sort free on ResearchRocket →

Related: Free card sorting tool · How to run a card sort · How to run a tree test · Optimal Workshop alternative