Keyword Research: The 2026 Playbook

Keyword research in 2026 is not what it was in 2016. The tools got smarter, the SERPs got noisier, and the gap between “find keywords” and “find keywords worth chasing” widened into a chasm. This playbook closes that gap — six workflows our team runs weekly to find keywords competitors miss, and the tools we use to do it.

Key takeaways

• Search intent and content format matter more than search volume — a low-volume transactional keyword often converts better than a high-volume informational one.
• Your own Search Console is the highest-signal data source you have. Most teams skip it and over-invest in third-party tools instead.
• Cluster by SERP overlap, not by keyword stem. If two keywords surface the same top 10 URLs, they are the same keyword.
• Competitive gap analysis finds the queries your site can actually win — not just the ones with the most volume.
• Refresh your keyword research every quarter. The SERP for any given query shifts between one and three times per year.

The two questions that beat every keyword tool

Before you open Ahrefs or Semrush, answer two questions:

1. What page does the intent deserve? If the SERP for your keyword is dominated by listicles and your competitor is shipping a 3,000-word how-to, you have a content-format gap. The keyword may be “saturated” — but the format is not.
2. Where is this query in the funnel? Informational queries top of funnel. Commercial queries middle. Transactional queries bottom. If you only write transactional pages, you have no top-of-funnel traffic to convert. If you only write informational pages, you have no money pages.

Getting these two answers wrong is the single most expensive mistake in keyword research. It produces pages that rank but do not convert, or content that earns traffic but funnels nowhere.

The five keyword categories that matter

Forget “head / mid / long tail”. Here is the taxonomy that actually maps to what you ship:

• Definition: “what is X”. Answer with a glossary entry. High volume, low conversion.
• How-to: “how to X”. Answer with a tutorial. Mid volume, mid conversion.
• Comparison: “X vs Y”. Answer with a comparison table. Mid volume, high conversion.
• Best-of: “best X for Y”. Answer with a curated list. High volume, high conversion.
• Alternative: “X alternative”. Answer with a comparison that includes yourself. Low volume, highest conversion. The full long-tail playbook — finding the uncompetitive queries your competitors miss, mapping them to clusters, and ranking them with topical depth — is in our Long-tail keyword strategy guide.

These five categories cover roughly 80% of commercial search intent. Most keyword research exercises are really just categorising a new keyword into one of these five buckets.

The data layer: what to pull

You only need four data sources. Most teams over-invest in keyword tools and under-invest in the first one — their own Search Console.

1. Search Console Performance. Queries, pages, countries, devices. Pull 16 months of data.
2. Search Console Discover → URL Inspection. The “Discovered, currently not indexed” report is a gold mine.
3. One backlink tool. Ahrefs or Semrush. Just for content gap.
4. Your CRM. Closed deals, attributed keywords. The keywords you already convert on.

The CRM data is the one most teams skip. If you know which keywords produced revenue last quarter, you know which commercial intents to protect. Treat your CRM as a keyword research input, not just a sales metric.

How to read search volume correctly

Search volume is the most misused number in keyword research. A tool showing 2,000 monthly searches for “CRM software” does not mean 2,000 potential visitors per month — it means approximately 2,000 searches across all result pages, all intent types, and all geographic variants combined.

What volume actually tells you:

• Volume above 1,000 signals established demand. The SERP will have real competition and multiple pages already serving the intent.
• Volume between 100–1,000 is often the sweet spot for niche B2B and local commercial queries. Less competition, higher intent per click.
• Volume below 100 is not “low volume” — it is specific intent. A keyword with 80 searches per month from a purchasing manager is worth more than 2,000 searches per month from a student.

The number in the tool is also a forecast, not a measurement. Most third-party tools estimate from sampled clickstream data and model it against Google’s search pool. For anything below 500 monthly searches, treat the number as directional.

The “SERP archaeology” workflow

For every cluster candidate, you want to know more than volume. You want to know the SERP:

1. Open an incognito window.
2. Search the keyword. Log every feature — ads, PAA, image pack, video, top stories, knowledge panel.
3. Click the top 10 organic results. Note their format, word count, year, schema.org types. Paste a competitor URL into our Keyword Density Checker to see exactly what terms they are optimizing for.
4. Run the same search on mobile. Note the differences — they are usually bigger than you think.

After 30 minutes of this, you can spot patterns your competitor’s content team cannot — every format gap, every freshness gap, every angle the SERP has never seen.

The specific things to record for each top-10 result: Is it a blog post or a product page? How recent was it published or updated? What schema type does it use? Does it answer the query in the first paragraph or the last? Does it have a FAQ section? These five data points tell you more than any keyword volume number.

Competitive gap analysis

Content gap analysis answers one question: which keywords are my competitors ranking for that I am not?

Run it like this:

1. Pick three competitors who rank well for your target topic.
2. In your backlink tool, enter their domains and use the “content gap” feature.
3. Filter to keywords with at least 10 monthly searches and ranking positions 1–20.
4. Remove keywords where you already have a page ranking in the top 5.

What remains is your gap list — queries where the SERP already validates demand, competitors have demonstrated it is rankable, and you have no current presence.

The mistake most teams make is running the gap analysis once and never again. The SERP changes. Your competitors publish new content. Run this quarterly and you will catch gaps before they become expensive missed opportunities.

Clustering the modern way

The classic “one keyword per page” model is dead. A single page can rank for hundreds of variants. Cluster by SERP overlap instead of by stem:

• Pull the top 10 URLs for each keyword.
• Compute Jaccard similarity between every pair of keyword SERPs.
• Threshold at 0.6. Keywords above the threshold are one cluster.
• Each cluster is one page (or one pillar + spokes).

Yes, this is more work. But it produces a content graph that maps 1:1 to Google’s topical understanding of your site. Clustering and topical authority are covered in our Content Strategy guide.

The practical shortcut: if you can paste two keyword queries into separate incognito tabs and the first page of results is 70%+ the same URLs, those two keywords are the same cluster. You do not need to compute Jaccard similarity manually to get this signal.

Common mistakes

• Chasing volume. 10,000 searches/month for a keyword you cannot rank for is a vanity metric.
• Ignoring SERP features. If the SERP has a PAA box, you should write the answer and earn it.
• Skipping competitor formats. The SERP tells you the format Google rewards. Stop arguing with the SERP.
• Keyword stuffing intent. Forcing a transactional angle onto an informational query burns trust.
• Running research once. Keyword research is not a project with a finish line. The queries that matter shift with every core update and seasonal cycle.

How often to repeat keyword research

For most sites, a quarterly keyword review catches the major shifts:

• Monthly: Scan Search Console for new queries entering positions 6–20. These are the queries one good piece of content away from ranking.
• Quarterly: Run a full competitive gap analysis. Refresh your understanding of the top-10 landscape for your core topics.
• After a core update: Treat every core update as a signal that your keyword assumptions may need revisiting. Check which of your top-performing pages held and which dropped.

The queries ranking 8–20 in Search Console are the highest-return targets in SEO. You already have topical authority for them. One well-targeted content refresh or expansion can move those queries into the top 5 within four to eight weeks.

Frequently asked questions

How long does keyword research take?

A focused keyword research session for one topic cluster takes two to three hours: 30 minutes mining Search Console, one hour running SERP archaeology across five to eight seed keywords, and 30 minutes clustering and prioritising by intent score. The output is a prioritised list of content opportunities ready to brief into a writer.

What is the most impactful keyword research mistake?

Scoring keywords by volume alone, without accounting for intent. A 5,000-search informational query that produces no conversions costs more to serve than a 200-search transactional query that closes deals. Weight every keyword by the commercial intent behind it before committing a content budget.

How do I find keywords my competitors have not found?

The content gap workflow — comparing three competitors’ keyword footprints against your own — surfaces keywords that third-party tools rank as high competition but where your competitors have not yet produced deep content. That combination of proven demand and underserved content is where new entrants win.

Does search volume matter at all?

Volume matters as a rough filter for viability, not as a ranking signal. Google does not know or use keyword volume. Volume matters to you because a keyword with near-zero searches cannot produce meaningful traffic regardless of how well your page ranks. Use it to filter the list, not to order it.

Can I target multiple intents with one page?

Rarely, and usually poorly. A page that tries to serve “what is X” and “best X for Y” simultaneously confuses both the searcher and Google’s classification of your intent. One page, one intent, one primary keyword cluster. Build the funnels between pages rather than combining intents on one page.

The bottom line

Keyword research in 2026 is SERP research. Volume is a lagging indicator. Intent, format, and SERP features are the leading indicators. Build your workflow around the SERP, not around Ahrefs’ volume column.

The teams that win in organic search are the ones who have done the SERP archaeology work — who know not just which keywords have volume, but which format the SERP rewards, which features the query triggers, and which intent the top results are actually serving. That knowledge is not in any tool. It is only in the SERP itself.