Skip to content

Canonical URL Duplicate Checker

Paste up to 2,000 URLs, one per line, and the page normalises each one and groups those that end up with the same address, so you can see at a glance that a list of 400 links is really 250 distinct pages. You choose whether a trailing slash, index.html or index.php, the order of the query parameters and tracking parameters such as utm_source count as differences. Lines that are not valid URLs are listed, never silently dropped. It helps you find candidates to canonicalise; it does not tell you what a search engine will do. Nothing leaves your browser.

Valid URLs and groups

6 URLs → 2 groups

2 groups with more than one line. Lines that are not valid: 1.
#Normalised addressLines
1https://example.com/shoes
  • https://Example.com/shoes/
  • https://example.com/shoes?utm_source=news
  • https://example.com:443/shoes#reviews
  • https://example.com/shoes/index.html
1, 2, 3, 4
2https://example.com/hats?a=1&b=2
  • https://example.com/hats?b=2&a=1
  • https://example.com/hats?a=1&b=2
5, 6
LineTextProblem
7example.com/no-schemeMust start with http:// or https://

Always applied: lowercase scheme and host, default port removed, fragment removed, dot segments resolved. Tracking parameters removed when ticked: any parameter whose name starts with utm_ (utm_source, utm_medium...), fbclid and gclid. These are candidates to review, not a statement that Google or any other system treats the addresses as identical: it picks its own canonical page.

How it works

  1. Paste your URLs, one per line, each starting with http:// or https://.
  2. Tick the differences to ignore: trailing slash, index.html or index.php, parameter order, tracking parameters.
  3. Read the summary of URLs and groups, then open the groups that have more than one line.
  4. Check the lines that could not be read, fix them if you want, and copy the groups, or only the repeated ones.

What people use it for

  • Cleaning a list of links from a crawl or an export

    See which entries are the same page written several ways before you build a canonical or redirect plan.

  • Spotting tracking parameters in shared links

    Group the same page shared with different utm_source values so that its real count is visible.

  • Checking a sitemap or internal link list

    Find addresses that differ only by case in the host, a default port, a fragment or a final slash.

Questions

What exactly is normalised?
Always: the scheme and the host are lowercased, the default port (80 for http, 443 for https) is removed, the fragment after # is removed, and dot segments such as /./ and /../ are resolved, all done by the browser's standard URL parser. With the options ticked: one trailing slash is removed from a path longer than /, a final index.html or index.php is replaced by its folder, query parameters are sorted by name then value and empty pieces between & signs are dropped, and tracking parameters are removed. The path itself keeps its case, because paths are case-sensitive.
Which parameters count as tracking?
A closed list: any parameter whose name starts with utm_, plus fbclid and gclid, compared without regard to case. Nothing else is removed, so a parameter such as ref, id or page stays and makes addresses different. Untick the option to keep all of them.
Does this show what Google treats as the same page?
No. Search engines choose their own canonical page using many signals, and two addresses that look the same here may be treated differently, or the reverse. Use the groups as candidates to review, then set a canonical tag, a redirect or a consistent internal link yourself. Whether a difference matters on your own site is a decision for you.
What are the limits and which lines are rejected?
Up to 2,000 non-empty lines and 500,000 characters in total, and each URL up to 2,048 characters. A line is listed as not valid, with the reason, when it does not start with http:// or https://, cannot be parsed, has no host, is too long, or contains a user name or password, which is refused so that credentials never end up in a copied list. Blank lines are skipped, but they still count for the line numbers shown. The copied text is the list of groups with their line numbers, built in your browser.