Well I still cannot harvest my own URL's. I let it go...it gets to about 2,600 then stops.....and there is no file of URL's to download..nothing.
You don't download them, they are automatically placed in the URL Harvester folder and named Google.txt, Yahoo.txt and MSN.txt then you merge them together in to one .txt file with the merger tool.
Ok here is why the new feature "Delete Same Site URL's" is so good. Because you are harvesting from 3 different engines, they all rank pages differently so you can wind up with different URL's from the same site for example:
Google:
site.com/post1
site.com/post2
Yahoo
site.com/post3
site.com/post4
MSN
site.com/post5
site.com/post6
Then when you merge the lists together a dupe remover wouldn't catch them because they are different URL's. Now if you scrape another related keyword and merge it with the first list, you can get even more pages from the same site.
I just tested this, i collected 8,000 URL's from similar keywords and merged them all in one file. I then removed "Same Site URL's" and my list was bought down to 4,782 URL's.
So.. Almost 50% of my list contained multiple URL's from the same domain. If i ran the first list of 8,000 most of my comments would of been declined because i am hammering the same blog numerous times.
I will get a "much" higher approval rate posting only ONCE to each blog with my smaller 4,782 list, because it won't look like i am spamming.