Remove Duplicate Lines
Paste a list and get a clean copy with every duplicate line removed. Free to use without an account, email address, or payment. The result downloads immediately after processing.
Paste a list and get a clean copy with every duplicate line removed.
Paste a list of emails, URLs, names, or any other lines and download a deduplicated copy in one click. Optionally ignore case and trim whitespace before comparing.
- Category: Text
- Availability: Free to use without an account, email address, subscription, or payment.
- Input: Entered in the browser
How it works
- Paste your list into the editor.
- Choose whether to compare case-sensitively and whether to trim each line first.
- Process and download the deduplicated.txt file.
Use cases
- Dedupe an email list before importing into a newsletter tool.
- Remove duplicate URLs from a scrape.
- Clean a copy-pasted list of names from a meeting invite.
- Drop repeated rows out of a long log paste.
Frequently asked questions
Is the order preserved?
Yes. The first occurrence of every line is kept in its original position. Only later duplicates are removed.
Can I match case-insensitively?
Yes. Untick 'Case-sensitive comparison' and 'Email@x.com' and 'email@x.com' count as the same line.
What about lines with extra spaces?
Enable 'Trim each line before comparing' and lines that only differ in surrounding whitespace are treated as duplicates.
How many lines can I dedupe?
Up to 2 MB of text per job, comfortably hundreds of thousands of lines.
Related tools
Using the interactive tool
Open the canonical HTML page to provide input and generate or download a result. This Markdown alternate contains the complete descriptive and instructional content, but it does not execute the interactive interface.