A case study of 2,000 Featured Snippets about deduplicating

After Google's deduplication of Featured Snippet URLs, I set out to dig into 2,000 Featured Snippets to find out what the true impact is.

Feb 03, 2020

After the chaos around the deduplication of Featured Snippets in the Google search results, I gave in to the itch and analyzed 2,000 Featured Snippets of www.g2.com. I’m happy to be first in line when it comes to screaming about a new feature or decision Google made that hurts websites. But what I noticed this time is that many of us started screaming before having proof of damage.

In this article, I describe how I analyzed the Featured Snippets and describe the exact results. Mind you, there is a lot of nuance to the analysis and lots of traps you can fall into. I recommend you to read the whole thing thoroughly.

In this article, I cover:

Vast differences of Featured Snippets on desktop vs. mobile
CTR differences between Featured Snippet types
Traffic differences between page types

FS Gate summary in 578 words

Here’s what happened: On 1/22, Google got caught at not displaying organic URLs if the page ranks in a Featured Snippet anymore and admitted that it changed something.

If a web page listing is elevated into the featured snippet position, we no longer repeat the listing in the search results. This declutters the results & helps users locate relevant information more easily. Featured snippets count as one of the ten web page listings we show. January 22, 2020

SEOs complained (luckily), Google caved and rolled out a whole lotta confusing changes.

Where we are now (2/1): Featured Snippets count as organic results and the ranking URL doesn’t show up anywhere else on the SERP, which doesn’t apply to Featured Snippet thumbnails, refined Featured Snippets, or other SERP Features.

For more information and case studies, check out further reading at the end of the article.

The trap of Feature Snippet impact analyses

Before we jump in, I want to make an important point: comparing the dates before and after 1/24 in search console to determine the impact is not enough. It implies many assumptions that don’t hold true.

Instead, we need to distinguish between:

Desktop and mobile because the SERPS look completely different
User intent based on query syntax
Featured snippet type
Country, if you get a lot of international traffic

If you just compare {date before} with {date after}, you mesh all of those in one pott and get distorted results.

In the example for the query “Coursera review” below, you see how the average desktop position is relatively steady while mobile bounces around like an 8-year-old.

Google desktop search results for "coursera review"

But on mobile, it’s a Double FS!

Also, pay attention to the headings in the mobile FS. On desktop, the FS content is about the quality of Coursera. On mobile, it’s about price and credibility.

Could it be that intent is different on mobile vs. desktop? Is Google’s understanding of the topic is so good that it knows what intent people have when they search on a smartphone versus desktop?

Another impact on click rates and traffic comes from Google’s growing desire to keep people in the search results.

A great example of that is the query “best animation software”, for which we rank in the Featured Snippet on desktop and mobile.

Look at the nice image thumbnails in the Featured Snippet box that attract so much attention. Yeah, they don’t lead you to www.g2.com but to another SERP. A bit unfair, if you ask me because those are results that we at G2 put together. Why wouldn’t they lead to our site where we provide you a ton of information and are specialized in software products?

In the “found on the web” box (FOTW Box), Google seems to show the first organic result first but the next result is just a swipe away. A very different click dynamic.

How to do a Featured Snippet deep dive

The big question is how to account for all the variables that distort a Featured Snippet analysis. The answer is a Featured Snippet deep dive.

Here’s how it works in a nutshell:

Pull your Featured Snippet queries from a 3rd tool.
Pull clicks, position, and CTR from Search console. If you want to find out what the impact of the 1/24 deduping update on your site was, pull the data before and after 1/24 (ideally 7 days).
Slice and dice, slice and dice.

Now, let’s talk about the details.

First, you need access to a 3rd party tool like SEMrush or AHREFS to pull your Featured Snippet queries. You need to what queries you rank in Featured Snippets for and Search Console won’t tell you (though it should).

I use SEMrush or AHREFS but can also recommend RankRanger.

RankRanger has a cool free tool that shows you desktop and mobile SERP features over the last 28 days.

Desktop

Go to “Organic Research”
Enter your domain (make sure to choose “subdomain”)
Go to “Positions”
Select “Featured snippet” under “Domain ranks”
Export

Exporting Featured Snippets with AHREFS

Go to the “Organic keywords” report
Click on “SERP features”, select “Featured Snippet”, and tick “Only linking to target”
Export

When you export Featured Snippets from 3rd party tools, make sure to look at when they discovered the FS. It probably makes sense to filter snippets out that have been discovered later than a month ago.

Second, use the “Search Analytics for Sheets” add-on for Google Sheets or the Search Console API to export queries, page, device (and country, if you get a lot of international traffic).

Third, open all three data pulls (one from your 3rd partyu want but make sure to compare CTR, clicks, and position for both, mobile and desktop.

Here’s what my analysis looks like:

Now that you know how to do it yourself, here’s what I found.

The impact of Featured Snippet Deduplication

The Featured Snippet rankings and traffic for www.g2.com dropped on the 22nd when Google deduped snippet URLs and regular results.

On the 24th, our FS traffic started to pick up (mobile: +17%, desktop: +21%) even though our rankings stayed flat.

Two interesting observations:

The first change on January 22nd seems to have impacted us negatively, then the modification on the 24th turned this around.
Ranking positions dipped slightly and stayed flat but traffic picked up.

Desktop Rankings (SEMrush)

lates (should) target certain user intents, which is reflected in the types of Featured Snippets Google shows (it’s all connected). If Google shows a list Featured Snippet, users probably want to see a step-by-step process or an overview of something. If you can’t provide that in your content, you’re not meeting a lot between our product and category pages and on mobile and desktop.

It becomes even clearer when you look at correlations. After getting over our issues with correlations 😉, you’ll notice that it’s much more likely for an increase in position to be followed by an increase in desktop traffic.

That’s not the case on mobile: we see that a higher position can lead to less traffic. The weak correlation is negative.

Mind you that none of the correlations in this analysis are strong. Not even the 0.47 correlation between click and CTR change would qualify as strong. So, take it with a big grain of salt or two. It’s still interesting to see how this plays out differently on mobile vs. desktop.

As last point, I want to raise awareness for query syntax. In the table below, I compare four query syntax with the modifiers “best”, “alternatives”, “price”, and “review” on desktop with mobile. As you can see for yourself, they’re different in three out of four cases.

You can certainly take an analysis too far, especially when the traffic we’re talking about here just isn’t that significant. But it still pays off to go deep once in a while to gain a solid understanding of what’s going on.

Search Console data is by no means perfect. In fact, I think Google should indicate where a URL ranks, i.e. in a SERP Featured and in which. But it’s a start and at scale tells a story.

Is FS deduplication a traffic killer?

Let me boldly say: no.

Let me also say that it highly depends on your vertical, brand strength, content quality, device, and type of Featured Snippet you show up for. So, a more refined answer would be: probably not for everyone.

That does not mean I support the endless SERP mazes Google is creating.

The FS deduplication is a signal to me that Google is more confident in the FS it displays.

The official talk track is that deduping “declutters the results”.

If a web page listing is elevated into the featured snippet position, we no longer repeat the listing in the search results. This declutters the results & helps users locate relevant information more easily. Featured snippets count as one of the ten web page listings we show. January 22, 2020

Some findings in this analysis lead me to believe that Google might have reached a level of understanding that allows it to serve different intent on mobile vs. desktop and do so very confidently.

At a recent Bay Area Search meetup, Gary Illyes mentioned that “Featured Snippets come from an extra algo that bids for that location.”

Gary also noted “Featured Snippets relate to the query more than a normal snippet. We try to pick passages that are more complete.”

I think that the FS position algorithm doesn’t exist anymore, but the algorithm that matches the query with the content still exists.

What I interpret into that is that we should look for queries within a topic that trigger Featured Snippets and create query-matching content for them in articles or on pages. Not that we haven’t done that before but because organic position #1 is the Featured Snippet now, you can’t rank at the top of the SERPS without query-matching content.

We also must write for mobile and desktop results, based on how the Featured Snippets differ.

Growth Memo

Discussion about this post