Duplicate content: how to find and fix it for SEO
Short answer Duplicate content isn't penalized. Google groups copies of a page, shows one, and may pick a version you didn't want. Find duplicates with URL Inspection in Search Console. Fix them with a 301 redirect when the copy shouldn't exist, or a canonical tag when it must stay. Don't use robots.txt or noindex for this.
Want help applying this to your business? Talk it through on a free 30-minute call.
Book a callIs duplicate content bad for SEO?
Not in the way most people fear. There is no penalty for ordinary duplicates. Google says so in its own documentation:
"Some duplicate content on a site is normal and it's not a violation of Google's spam policies." (Google Search Central: What is canonicalization)
What actually happens: Google spots pages that look the same, groups them, and picks one to show in results. That chosen page is the canonical. The others are crawled less often and rarely appear (same page).
Three real costs follow:
| Problem | Why it matters |
|---|---|
| Google may show the wrong version | An old `http://` page or a link with tracking code on the end can appear instead of your clean service page |
| Credit gets split | Links from other sites point to different versions. Naming one canonical lets Google merge that credit into one page (Google Search Central) |
| Your numbers get messy | Visits spread over several addresses, so one page's results are hard to read (same page) |
The one case that can hurt: copying other sites' content to rank. Google's spam policies list republishing others' content "without adding any original content or value" as abusive scraping (Google Search Central: Spam policies). That's a content problem, not a technical one.
What causes duplicate content on a small business site?
Mostly the website setup, not the writing. The same page opens at more than one address (URL).
| Cause | Example | Usual fix |
|---|---|---|
| Secure and old versions both work | `http://` and `https://`, with and without `www` | 301 redirect all to one |
| Tracking or sorting codes | `/drain-cleaning/?gclid=123` from an ad click | Canonical tag on the clean URL |
| Capital letters or a trailing slash | `/Roof-Repair` and `/roof-repair/` | Redirect, and link one way only |
| A test or demo copy left open | `staging.yoursite.com` indexed by Google | Password-protect it |
| Old and new pages after a rebuild | `/services.html` and `/plumbing/` with the same text | 301 redirect old to new |
| Same-language country sites | A US page and a Canadian page that say the same thing | Canonical tags plus hreflang |
Google lists these same groups: protocol, region, device, sorting and filtering, and "accidental variants" such as a demo site left open to crawlers (Google Search Central). It also says URLs are case sensitive, so `/Roof-Repair` and `/roof-repair` are two pages to Google (Google Search Central: URL structure).
If you serve both the US and Canada with near-identical pages, Google calls those regional duplicates. It recommends using both canonical tags and hreflang (a tag that says which country or language a page is for) so the right page shows in each country (Google Search Central). See multilingual and regional sites.
How do I find duplicate content on my website?
Start with Google's own view, in Google Search Console (free).
- URL Inspection on your key pages. Paste your home page and each main service page. It shows which URL Google picked as canonical. Google's troubleshooting guide starts here (Google Search Central: Fix canonicalization issues).
- The Page indexing report. Look for the duplicate statuses. "Duplicate without user-selected canonical" means Google picked a version itself; "Duplicate, Google chose different canonical than user" means it ignored yours (Search Console Help: Page indexing report). What each status means is in our guide to Page indexing statuses.
- Type the four versions of your address into a browser: `http://`, `https://`, with and without `www`. All four should land on the same one. If two stay put, you have duplicates.
- Search `site:yourdomain.com` on Google. Scan for the same title appearing twice, or addresses with `?` codes.
- Search one sentence from your page in quotes. Other sites showing the same sentence have copied it, or you copied a supplier's text.
How do I fix duplicate content?
Pick by whether the copy needs to keep working.
| Method | Use it when | Strength |
|---|---|---|
| 301 redirect | The copy shouldn't exist (old page, `http`, non-`www`) | Strong |
| Canonical tag | The copy must keep working (tracking codes, sort order, a printer version) | Strong |
| List only the main URL in your sitemap | Backup signal on any site | Weak |
| Make the pages genuinely different | They are really separate services or places | Splits them for good |
Google ranks redirects and canonical tags as strong signals and sitemaps as weak, and says they work better combined (Google Search Central: How to specify a canonical URL). Your choice is a hint, though:
"indicating a canonical preference is a hint, not a rule." (Google Search Central: What is canonicalization)
Also link to the main version everywhere on your site. Google says consistent internal links help it understand your preference (same page as the methods above).
How do I add a canonical tag?
Add one line to the head section of each copy's code, pointing to the main page. It is a link element with `rel="canonical"` and `href` set to the main page's address, such as `https://www.yoursite.com/drain-cleaning/`.
- Use the full address, `https://` and all. Google supports short paths but doesn't recommend them.
- Add the same tag to the main page, pointing to itself.
- Google only reads it in the head section.
All three rules come from Google's canonical guide (Google Search Central). On Wix, WordPress or Blogger you may not edit code: Google says your platform may set canonicals from an SEO settings page instead (same page). If you're choosing a platform, see how Wix, Squarespace and WordPress compare.
After a fix, Google says pages can stay grouped as duplicates "for up to two weeks". You can then use Request Indexing in URL Inspection for your most important pages (Google Search Central: Fix canonicalization issues).
Mistakes that make duplicate content worse
| Mistake | What Google says |
|---|---|
| Blocking copies in robots.txt | Don't. Google may still index blocked URLs without their content |
| Adding noindex to a copy | Not recommended: it blocks the page from Search entirely. Use a canonical tag |
| Using the URL removal tool | It hides every version of the URL |
| Naming different canonicals in different places | Sitemap and tag must agree |
| Pointing pages 2, 3, 4 of a list to page 1 | Each page in a series gets its own canonical |
| Looking for the URL Parameters setting | Google retired it in 2022; it now handles codes like `?sort=` on its own |
The first four are from Google's canonical guide (Google Search Central). Pagination is from its pagination guide (Google Search Central). The parameter tool's end was announced in March 2022 (Google Search Central Blog).
What if another site copied my content or republishes my articles?
If you let a partner republish your articles, ask them to keep their copy out of Google:
"The canonical link element is not recommended for those who want to avoid duplication by syndication partners, because the pages are often very different. The most effective solution is for partners to block indexing of your content." (Google Search Central: Fix canonicalization issues)
If a site copied you without permission, Google says you can ask its host to remove it, and ask Google to drop the page through a Digital Millennium Copyright Act (DMCA) request (same page). Google's removal steps are in removing information from Google.
Example
A plumber whose ad links show up in search
URL Inspection shows Google picked `/drain-cleaning/?gclid=...` as canonical. The owner adds a canonical tag pointing to `/drain-cleaning/` and links to that clean address in the menu. A few weeks later, URL Inspection shows the clean URL as Google's pick.
A dentist after a site rebuild
The old `/services.html` and the new `/teeth-whitening/` both load, with the same text. A 301 redirect from old to new removes the copy and carries the old page's links over.
A cleaning company serving Seattle and Vancouver
The US and Canadian pages are word-for-word the same. Each gets a canonical tag pointing to itself and hreflang tags marking `en-us` and `en-ca`, so each country sees its own page.
FAQ
Does Google penalize duplicate content?
Not for ordinary duplicates on your own site. Google says it's normal and not a spam violation. Copying other sites' content to rank is different: that falls under its scraping policy.
Should I use a 301 redirect or a canonical tag?
Redirect when nobody needs the copy. Use a canonical tag when the copy has to keep working, like a page with tracking codes.
Why does Google ignore my canonical tag?
It's a hint. Google may pick another page if signals conflict, such as links, redirects or a sitemap pointing elsewhere. Check what Google picked in URL Inspection and make every signal agree.
Are similar service pages for different towns duplicate content?
If only the town name changes, Google may group them and show one. Pages built mainly to catch town searches can also count as doorway pages; see city pages.
How often should I check?
After any site rebuild, platform change or domain move, and when the Page indexing report shows new duplicates. A small site rarely needs more.
Different for you?
- Several old pages cover the same topic? Merge them and redirect: update, merge or delete old pages.
- Traffic fell after a new website launched? Duplicates and missing redirects are common causes: traffic dropped after a redesign.
- Online store with color and size variants? See ecommerce SEO.
- New to Search Console? Start with the reports to read.
- Want someone to run these checks? See SEO.