Short answer
Google’s deduplication systems hide results that are very similar to ones already shown, and stop a page that appears as a featured snippet from appearing again as a normal listing on page one. Neither is a penalty. If your page won a featured snippet and its usual listing vanished, that is deduplication working as designed, and your visibility probably went up, not down.
Deduplication explains two of the most confusing things site owners see in search. A page that wins a featured snippet seems to lose its ranking, and a page with content shared across several sites seems to disappear.
Both are the results page tidying itself, not a judgement on your site. The useful question is whether the version Google shows is the one you want it to show.
What deduplication does
Google describes the problem in its guide to ranking systems. A search can match thousands or millions of pages, and some of them are very similar to each other. Rather than fill the page with near-copies, its systems show only the most relevant.
- Near-identical pages are filtered. When several results say essentially the same thing, most are held back.
- Omitted results can still be viewed. Google sometimes adds a note that very similar entries were left out, with an option to repeat the search including them.
- Featured snippet pages are not repeated. A page shown as the featured snippet does not appear again as a normal listing on the first page.
The featured snippet rule
Since January 2020, a page shown in a featured snippet has not been repeated as a regular listing further down page one. Before then, the same page could appear twice: once in the snippet and once in the normal results.
From the outside this can look like a loss, especially in rank trackers that follow normal listings. In practice the page still occupies the most prominent spot on the page. Search Console records the snippet as the page’s position, usually at the top.
Some sites tried blocking their snippets to get the ordinary listing back. That usually costs more than it gains, because the snippet is the more visible result, and the normal listing that returns may sit lower down.
If you lost the snippet itself, rather than the normal listing beneath it, that is a different problem with different causes, covered in lost my featured snippet.
Near-duplicate pages across the web
The same text often appears on many sites. Press releases, syndicated articles, manufacturer product descriptions and copied content all create clusters of near-identical pages.
- Google shows one version from the cluster, and holds the rest back.
- The version shown may not be yours. A larger site republishing your article can be the one that appears.
- Original content systems help the source, but they work best when the copies are clearly marked or kept out of the index.
A real case of two sites carrying the same articles, and why Google chose the one it did, is covered in the duplicate content case study.
A worked example: one press release, forty sites
A company publishes an announcement on its own site and sends it through a news wire. Within a day the same text appears on forty other sites.
Google shows one or two of them for searches about the announcement, and often it is the wire service or a large news site rather than the company. The company’s own page is just one more near-copy in the cluster.
The fix is to make the original the fullest version. Publish on your own site first, with extra detail the wire copy lacks, such as quotes, figures, images and context. Then make sure the distributed copies link back to it.
Two kinds of deduplication
| In the results | In the index | |
|---|---|---|
| What it decides | Which similar pages to show for a search | Which of several duplicate URLs to keep as the main version |
| Where you see it | Missing listings, omitted results notes | The Pages report in Search Console |
| Typical cause | Similar pages on different sites, or a snippet | Duplicate URLs on your own site |
| What to do | Make your version clearly distinct or the obvious original | Set canonicals and remove unnecessary duplicates |
Index-level duplication is the one you control completely, because it happens inside your own site.
Duplicates inside your own site
Search Console’s Pages report shows the decisions Google made about duplicate URLs on your site. Three statuses matter most:
- Alternate page with proper canonical tag. Google agreed with the canonical you set. This is fine.
- Duplicate without user-selected canonical. Google found duplicates and you did not say which is the main one, so it chose for you.
- Duplicate, Google chose different canonical than user. You set a canonical, but Google preferred another URL. Worth checking, because it often points to a template or redirect problem.
Common causes are tracking parameters, filtered and sorted product listings, printer-friendly versions and the same page reachable at several addresses. How to work through the Pages report is covered in the Search Console recovery guide.
Syndication and copies of your content
If other sites republish your articles, the copy can outrank the original. Google’s current guidance suggests that, if you want your own version to be the one shown, syndication partners should keep their copies out of the index with a noindex tag.
- Agree the terms before you syndicate, including how the partner will handle indexing.
- Publish first on your own site, and make sure it is crawled before copies appear.
- Link back clearly from every syndicated copy to the original.
Scraped copies are a different matter. Where content is copied without permission, valid copyright removal requests are the formal route, and Google’s removal systems also take account of sites receiving many of them.
Product descriptions at scale
Shops that use manufacturer descriptions share their text with every other shop selling the same products. Rewriting thousands of pages at once is rarely realistic.
Start with the products that earn the most revenue, and add what only you can: your own photographs, sizing advice, answers to questions customers actually ask, and honest notes on who the product suits. A few hundred distinct pages do more than thousands of copies.
How to tell deduplication is affecting you
- A page gained a featured snippet on the same day its normal listing disappeared.
- Your content also appears on other sites, and one of them shows instead of you.
- Many of your product pages share manufacturer descriptions with dozens of other shops.
- The Pages report shows growing numbers of duplicate statuses after a site change.
If none of these fit, the cause is probably elsewhere. Missing third listings are usually Google’s site diversity system, and broader drops start with why did my website traffic drop overnight.
What to do
- Make your version clearly different. Original analysis, your own photographs and first-hand detail turn a near-copy into a distinct page.
- Rewrite shared product descriptions for the products that matter most, starting with your best sellers.
- Set canonicals deliberately and keep internal links pointing at the canonical version.
- Consolidate your own near-duplicates, redirecting the weaker versions to the strongest.
- Leave featured snippet deduplication alone. It is working in your favour.
Where deduplication sits among Google’s other systems is covered in Google’s ranking systems explained.
Is Google showing someone else’s copy of your content?
Syndication, shared descriptions and duplicate URLs can all hand your visibility to another version. Send your Search Console access and within 48 hours I will tell you which version Google prefers, and why.
Get free recovery audit