Remove duplicate lines
Paste a list. Repeated lines are removed, the first copy stays, and the order does not change.
What was removed
How it works
Lines split at line breaks, whether your list came from Windows, Mac or Linux.
A line break at the very end does not add an empty line, and the result ends with a line break only if your list did.
Two lines are the same only if every character matches, unless you turn a switch on.
The first copy of a line is kept exactly as you typed it. The switches change the comparison only, never your text.
- Ignore upper and lower case: plain lower-casing, nothing more. German ß and SS, or Turkish İ and i, are not treated as the same.
- Ignore spaces at the start and end: lines that differ only by spaces, tabs or non-breaking spaces at either end count as the same.
- Treat look-alike accents as the same: on by default. An é typed as one character and an é typed as e plus an accent count as the same line.
- Remove blank lines: off by default, so the first blank line stays like any other line. When on, every blank line (empty, or only spaces and tabs) is removed.
A zero-width space, or a non-breaking space while the edge-spaces switch is off, keeps two look-alike lines apart.
This page handles up to 200,000 lines or 2,000,000 characters. Above that it changes nothing and says so.
The list of what was removed shows the first 200 rows, then how many more.
This page does not save or send what you paste.