remove duplicate entries from groups file

Commands in mothur
#1

somehow I have some sequences duplicated in my groups file-I don’t know how that happened. the lines are completely identical

sequencexyz groupA
sequencexyz groupA

any ideas how to find and remove the duplicates? I tried list.seqs on the names then get seqs but it selects both lines since they match the sequence name. This is a huge dataset 7.5M reads post cleaning and trimming so don’t want to just rerun trim.seqs unless there’s no other way

#2

If you’re using mac/unix you can do…


sort file.groups | uniq > newfile.groups
#3

thanks