Guide

Duplicate Content: Finding and Fixing It

Duplicate content means the same or near identical text living at more than one URL. The fix is to choose one version and tell Google clearly which one it is.

Duplicate content is the same or very similar content reachable at more than one URL. Google does not usually punish it. It does something quieter: it picks one version to show and ignores the rest, which can split links across copies, waste crawl time, and sometimes pick the wrong URL. Fixing it means choosing the version you want ranked and making that choice obvious.

How duplicate content happens

Most duplication is accidental and technical, not copied from another writer. The usual sources are:

Content copied from your site by someone else is a separate problem. Our guide to scraped and duplicated content attacks covers it.

Does duplicate content cause a penalty?

Almost never. Google's documentation says duplicate content on a site is not a reason for action unless it is clearly meant to deceive or manipulate. What you usually lose is clarity: ranking signals divided between copies, and the wrong URL chosen. Our short answer on whether duplicate content causes a penalty sets out the exceptions.

How to find duplicate content

Run these checks

Finding duplicate URLs on your site

The Google selected canonical is the most useful clue. When it differs from the one you set, Google has decided your signals disagree, and that is where to start.

Six places to look

  • Search Console Pages report: look for Duplicate without user-selected canonical and Duplicate, Google chose different canonical than user.
  • Run a site crawl and group pages by identical or near identical titles and body text.
  • Search a distinctive sentence from a page in quotes and see which of your URLs appear.
  • Use the URL Inspection tool to compare your declared canonical with the Google selected canonical.
  • Check how your site responds to http, https, www and non www versions of the homepage.
  • Review the URLs in your sitemap for parameters, duplicates and redirected addresses.

Which fix to use

Different duplicates need different fixes. Pick by what the duplicate URL is for.

SituationBest fixWhy
Old or alternate URL that should not exist301 redirect to the main URLPasses signals and removes the copy
Both URLs needed for users, such as filtersCanonical tag pointing to the main pageKeeps the page live, names the preferred version
http, https, www and non www versionsSite wide 301 redirects to one versionOne canonical host for every URL
Near identical product or location pagesMerge into one page or rewrite each to be distinctGives each URL a reason to exist
Thin parameter or tag pages with no valueNoindex, or remove and redirectKeeps junk out of the index
Pages that must not appear at allPassword protect or noindexRobots.txt alone does not remove a URL
Choosing a duplicate content fix by situation

Step by step duplicate content fixes

1. Pick the preferred URL

For every group of duplicates, decide which URL should rank. Choose the cleanest, most linked version, usually https, one host name, and a consistent trailing slash rule.

2. Redirect what should not exist

Set 301 redirects from the unwanted versions to the preferred one. Redirect each page to its direct match, not everything to the homepage. Avoid chains of redirects.

3. Add canonical tags where both URLs stay live

Place a self referencing canonical on every indexable page and point filtered or parameter versions to the main page. Make sure the canonical is not blocked, redirected, or pointing at a page that is itself noindexed. Common errors are in our guide to canonical tag mistakes.

4. Rewrite or merge near duplicates

If two pages answer the same question, merge them into one stronger page and redirect the other. If both are needed, rewrite each so it serves a distinct purpose and adds something the other does not.

5. Clean your internal signals

Update internal links, your sitemap and your hreflang tags to use the preferred URL only. Mixed signals are how a good canonical plan fails.

6. Recheck in Search Console

After changes are crawled, watch the Pages report. The duplicate counts should fall. Use URL Inspection on a sample to confirm the Google selected canonical now matches yours.

When to call for help

Get help when the site has thousands of parameter URLs, when Google keeps choosing a canonical you did not pick, or when a migration or platform change created a wall of duplicates. These are often tied to wider crawl and indexing problems, not just text.

We start by finding which duplicates are actually costing you traffic, then fix those first. Ask for a free SEO triage and see what our technical SEO fixes work would cover.

FAQ

Questions owners ask us

How much duplication is too much?

Google gives no percentage. Small overlaps like a shared footer or a short product spec are normal. The problem is whole pages that match, or many URLs that serve one page. Judge by whether a reader and a crawler could tell the pages apart.

Should I use a canonical tag or a 301 redirect?

Use a 301 redirect when the duplicate URL should not exist at all, such as an old or alternate version. Use a canonical tag when both URLs must stay live for users, such as a filtered product list. A redirect is the stronger signal.

Can I fix duplicate content by blocking it in robots.txt?

Usually not. A robots.txt block stops Google crawling the page, so it cannot see a canonical tag or redirect on it. The URL can still be indexed from links. Fix duplicates with redirects or canonicals instead. If you are stuck, request a free SEO triage.

Get started

Tell us where it hurts.

Your site, what changed and when. We reply with a first read on the cause.