File Filter

Before adding six more criteria.

-------- Summary ---------------------------------------------------------------
Total files processed     > .............................................. 73574
Good files in playlist    > .............................................. 44248
Bad files out of list     > .............................................. 12611
Fantastic files           > ............................................... 5429
Number of Duplicates      > .............................................. 13695
-------- time ------------------------------------------------------------------
Process h:m:s             > .............................................. 0:8:3
Elapsed h:m:s             > .............................................. 0:8:3
Files/second              > ................................................ 152
reg ex count              > ............................................. 317957
CPU h:m:s of this process > .............................................. 0:7:9
-------- Info ------------------------------------------------------------------
Good file                 > ..................................... kelly_good.m3u
Fantastic file            > ...................................... kelly_fan.m3u
Log file                  > ..................... kelly_log_2010-07-12_07-28.log
Directory processed       > ..................................... ['/mnt/music']
Items in kill list        > ................................................ 172
Items in fantastic list   > ................................................. 78
Options                   > .......................................... See below
 ['-o', '-g', 'kelly_good', '-f', 'kelly_fan', '-l', 'kelly_log']
--------------------------------------------------------------------------------

After

-------- Summary ---------------------------------------------------------------
Total files processed     > .............................................. 73574
Good files in playlist    > .............................................. 42904
Bad files out of list     > .............................................. 14098
Fantastic files           > ............................................... 5415
Number of Duplicates      > .............................................. 13552
-------- time ------------------------------------------------------------------
Process h:m:s             > ............................................. 0:7:36
Elapsed h:m:s             > ............................................. 0:7:36
Files/second              > ................................................ 161
reg ex count              > ............................................. 313496
CPU h:m:s of this process > ............................................. 0:6:45
-------- Info ------------------------------------------------------------------
Good file                 > ..................................... kelly_good.m3u
Fantastic file            > ...................................... kelly_fan.m3u
Log file                  > ..................... kelly_log_2010-07-12_12-52.log
Directory processed       > ..................................... ['/mnt/music']
Items in kill list        > ................................................ 178
Items in fantastic list   > ................................................. 78
Options                   > .......................................... See below
 ['-o', '-g', 'kelly_good', '-f', 'kelly_fan', '-l', 'kelly_log']
--------------------------------------------------------------------------------

Note over a thousand files are added to the bad files list. Note the time and regex decrease. This is because of the way I nested the loops. The more you eliminate from the bad list the fewer duplicates you have to check for.