commonline or removeing duplicate lines

[neilbaker]

Does anyone know how to remove duplicate lines from a file or var without useing the filter or replace commands. I've tried those and they take way to long About a hr and I have 5000 files to go thru. I'm still useing "studio" version. This script worked once
put commonLines (a,b) into c but after running it once it wouldnt work again and that code is in the documentation recipe for studio. If anyone can help this beginner will surely appreciate it.

[BvG]

put it as keys into an array, then back again. There can always be only one key of the same text, so there'll be an automatic removal. Use a nonexistent char as secondary delimiter, to make sure nothing gets actually put into the contents of the array. for example:

Code: Select all

split theData by return and numtochar(0)
combine theData by return and numtochar(0)