Duplicate Line Remover
Input
Result
ExampleHow to use
1.
Paste your text into the Input panel, one item per line
2.
Switch on Ignore case, Ignore surrounding whitespace, or Remove blank lines as needed
3.
Click Copy on the Result panel - it updates as you type, and its header counts the lines and the duplicates removed
Common uses
▸
Removing duplicate entries from a list of names, IDs, or URLs
▸
Cleaning up log output or export data
▸
Deduplicating mailing lists before importing them
Similar tools
Frequently asked questions
Which copy of a duplicate line is kept?
The first occurrence of each line is kept; all subsequent duplicates are removed. The original order is preserved.
Is the comparison case-sensitive?
By default yes, but you can turn on Ignore case so "Hello" and "hello" are treated as duplicates. The first spelling is the one kept.
What does Ignore surrounding whitespace do?
When it is on (the default), spaces and tabs at the start and end of a line are ignored when comparing, so " foo " and "foo" count as the same line. Only the comparison ignores them: the line that is kept appears in the result exactly as you typed it, so indentation in code or YAML is preserved.
Is my text sent to a server?
Everything runs in your browser. No data is uploaded or stored.
What happens to blank lines?
Blank lines, including lines holding only spaces or tabs, are never counted as duplicates, so the empty lines separating paragraphs are kept. Turn on Remove blank lines to drop all of them. The Result header shows the line count before and after, and how many duplicates and blank lines were removed. A newline at the very end of the text is preserved.