Account Login  Username:  Password: 

A fast method to Remove Duplicates from Word Lists

by Richard V.
Category: String Manipulation
Difficulty: Beginner
Date Added: Wed 3 February 2021
Rating: (2 Votes)

Remove duplicate items from word lists.

Assumes
'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 'Removes duplicates from large (milllions) wordlists quickly ' 'Sorts wordlists using the quicksort algorithm, then 'removes duplicates in a single pass, O(n), by comparing 'each item against the preceding item. ' 'Items can be "unsorted" back to the order of the original 'wordlist with the use of an array of indexes, a new 'array containing the original position of each item. ' 'Stable Quicksort algorithms by Rde. 'http://www.pscode.com/vb/scripts/ShowCode.asp?txtCodeId=63941&lngWId=1 ' 'Much(!) faster Split replacement, "Quick Split," by Merri @ VBForums.com. '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 'Note: memory usage issues

Rate A fast method to Remove Duplicates from Word Lists

Download A fast method to Remove Duplicates from Word Lists

Download A fast method to Remove Duplicates from Word Lists (14 KB)

A fast method to Remove Duplicates from Word Lists Comments

No comments have been posted about A fast method to Remove Duplicates from Word Lists. Why not be the first to post a comment about A fast method to Remove Duplicates from Word Lists.

Post your comment

Subject:
Message:

0/1000 characters