Use this tool to easily find list items that occur more than once. Specifically, it will sort the lines of your text files alphabetically and then look for adjacent lines that exactly match each other. You will receive two files as output. One will be a list of lines appearing more than once. The other will be a list of all unique lines (second, third, forth, redundancy eliminated).
The tool uses Unix commands at its core. For example:
sort my_file.txt | uniq -d > list_of_duplicate_lines

Please contact us if you like this feature or have ideas for its improvement.
Also, contact us if you plan to submit files over 100Mb.

Text file to upload (gzipped or uncompressed):

Email address to send results (required):

---

Begin analysis now.