Overview
Deduplicate text by lines for faster cleanup of lists: keywords, emails, IPs, IDs, and more. Great for preparing inputs for scripts, spreadsheets, and automation. Runs locally in your browser.
Use cases
- Remove duplicate keywords before uploading to an ad platform.
- Deduplicate a list of IDs copied from logs.
- Clean and sort a list before feeding it into a script.
Common pitfalls
- Windows line endings (CRLF) can create invisible differences—normalize inputs if needed.
- If your list is comma-separated, split it into one-item-per-line first.
FAQs
Are empty lines kept?
No. Empty lines are removed by default.
How is sorting done?
Sorting uses lexicographic order (localeCompare). For numeric sorting, consider zero-padding or post-processing.
Is it case-sensitive?
Deduplication is typically case-sensitive unless the tool explicitly normalizes case. If needed, convert case first.
Does it trim whitespace?
If trimming is enabled in the tool UI, leading/trailing whitespace will be removed before deduplication.
Examples
Input
a\nb\na\n
Output
a\nb