Duplicate content refers to identical or largely identical content reachable under multiple URLs – either within the same domain or across different domains. From the users’ perspective that’s often harmless: the text simply sits once here, once there. From the search engines’ perspective it’s a problem. Google has to decide which of the duplicated pages to show in the search results, and, in case of doubt, splits the ranking signals across all variants instead of bundling them on one canonical URL. The result: lost visibility, wasted crawl budget and, in extreme cases, even removal from the index.
Internal vs. external duplicate content
| Type | Where does it arise? | Examples |
|---|---|---|
| Internal | within the same domain | /produkt/abc and /produkt/abc?ref=newsletter, www.example.com and example.com, /page and /page/ |
| External | between different domains | Manufacturer product copy 1:1 in the shop, identical content on example.de and example.com, content scrapers |
Internal DC is mostly the result of URL parameters, missing redirects or unclean pagination structures. External DC usually arises through unmodified adoption of texts, whether legitimate (manufacturer descriptions, press releases) or unlawful (content theft).
Typical causes
- URL parameters: tracking (
?utm_source=…), sort/filter URLs (?sort=price), session IDs - HTTP vs. HTTPS: both variants reachable, no redirect
- www vs. non-www: both hosts deliver the same content
- Trailing slash:
/pageand/page/treated differently - Print versions:
/article/printalongside/article - Pagination without a
canonicalstrategy:/blog?page=2shows partially the same content as/blog - Multilingualism without
hreflang:/de/and/at/with identical German text - Manufacturer product copy 1:1 in the online shop
- An indexable staging environment:
staging.example.comgets crawled and competes with production
SEO effects
Google doesn’t punish duplicate content directly with a manual penalty (except for blatant scraping or manipulation). The indirect consequences are massive, though:
- Split ranking signals: backlinks, click signals and user engagement scatter across several URLs instead of bundling on one
- Wasted crawl budget: the web crawler visits duplicates instead of finding new or updated content
- The wrong URL in the index: a parameter URL ranks instead of the clean canonical variant – bad for click-through rate and trust
- Lost featured snippets / rich results: structured data is partially ignored when the canonical URL is unclear
Solutions
1. Canonical tags
A <link rel="canonical" href="…"> in each page’s <head> tells Google the “master URL” that should rank:
<link rel="canonical" href="https://www.example.com/produkt/abc">
Important: set a self-canonical (every page points to itself); for duplicates, the duplicate points to the original.
2. 301 redirects
For structural DC (HTTP→HTTPS, www→non-www, trailing slash, old URLs after a relaunch), a permanent 301 redirect is the cleanest route:
RewriteEngine On
RewriteCond %{HTTPS} off
RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI} [R=301,L]
RewriteCond %{HTTP_HOST} ^example\.com [NC]
RewriteRule (.*) https://www.example.com/$1 [R=301,L]
3. noindex for areas without SEO value
Filter, sort and search results pages often land in the index without belonging there. Exclude them cleanly via meta tag or HTTP header:
<meta name="robots" content="noindex, follow">
4. Consolidate URL parameters
Tracking parameters (utm_*) don’t belong in the index. In Search Console you can specify which parameters Google should ignore, even better: point server-side via canonical to the parameter-free URL.
5. hreflang for multilingualism
When the same language variant exists on multiple domains/paths (/de/, /at/, /ch/), clarify via hreflang tags which variant applies to which country:
<link rel="alternate" hreflang="de-DE" href="https://example.com/de/">
<link rel="alternate" hreflang="de-AT" href="https://example.com/at/">
6. Unique content instead of standard copy
In the online shop: rewrite manufacturer texts, add your own benefit communication, integrate reviews. That solves external DC and boosts conversion at the same time.
Tools for finding duplicate content
- Google Search Console: the “Coverage” area shows “Duplicate, not selected as canonical by user”
- Screaming Frog SEO Spider: finds identical titles, descriptions and body content
- Sistrix / Ahrefs / Semrush: DC detection at domain level
- Siteliner: free for small domains, checks internal duplicates
- Copyscape: for external DC, checks texts against the open web
Frequently asked questions about duplicate content
How much overlap counts as duplicate content? There’s no official threshold. In practice, problems are to be expected from ~60–70% text overlap – depending on industry and competition.
Is duplicate content legally actionable? Not from an SEO perspective – Google sanctions internally. DC only becomes legally relevant when third-party, copyrighted texts are adopted without a licence.
Are manufacturer product texts an SEO problem? Yes. If 50 shops use the same text, effectively only one of them can land a top ranking, usually the one with the highest authority (Amazon, big brands). Your own, unique copy is the most important lever here.
Are paginated lists DC? Not necessarily. As long as the listings show different content (page 1: products 1–20, page 2: 21–40), it’s not DC. Only when all pagination pages show the same products or empty lists does it get critical.
How does DC affect Google Ads? DC influences the Ads quality score indirectly: landing pages with heavily duplicated content receive worse quality ratings, which raises click prices.
Conclusion
Duplicate content is rarely intentional, usually a configuration problem or technical legacy. Clean it up systematically (canonical, 301, parameters, unique copy) and you frequently gain noticeable organic visibility without producing new content. We check duplicate content problems as part of every SEO audit and fix them structurally – feel free to reach out for a no-obligation consultation.