I also have a Q on the scraper is somebody can help:
1. If we scrape for example: 'vitamins' and 'vitamins and minerals' and 'vitamins for hair'
Does this mean that all results with 'vitamins' will be repeated when we scrape 'vitamins and minerals' ?? or are these then mostly new results
2. when we have our harvested blogs there are many duplicate domains that appear with several blog entries. Is it wise to hit the 'remove duplicate domains' button?? Otherwise we will be commenting multiple times on the same domain... On the other hand we may remove the high pr blog posts with this action, and leave the zero PR blog to comment on, surely not what we want. Yes, i know we can check on pr first but its a pain in the butt to check 3000 urls for PR and takes the whole day..
Thanks
1. It collects what Google returns, if you go to Google and search "vitamins" then search "vitamins and minerals" you will see the results aren't exactly the same. Some sites will rank both terms, some just one term. You can also use advanced search operators in the harvester like intitle: or inurl: etc to mix things up along with timeline searches etc.
2. If you are blasting just one domain to a list of blogs or using no proxy, it's best to remove dupe domains. If you have all files loaded up with many variations randomly rotating and using proxies, sure just hit them all.
As for one blog post have PR1 and another having PR3 on a blog and worrying about cleaning the list of dupes then i really wouldn't worry. Both URL's are on the same domain, the PR data is stale so the PR1 may be a PR4 next update and the PR3 dropped to PR0 because it's buried many clicks from the homepage.
Link checker is showing status as "Not Found" for all harvested movie keywords....what might be the problem??
The link checker doesn't check keywords, it checks links. Did you load a keyword list in to it?
I am used to using another scraper that was good until I found this. I figured I would harvest a few thousand and let her rip. Anyway I loaded it up and the damn thing is already over 160k and still scraping away like a trooper.
I don't want to box my affiliate and get kicked out of the program. I am using shorturl*com will they take the hit and shield my aff from the sand?
Yes the scraper goes good now, i've had it up to 6 figures of URL's with a huge keyword and proxy list.
With your short URL, if your going: Spam Links > TinyURL > Affiliate Company then there's no problems with Google. If the TinyURL is pointing at your site, then Google passes virtually no benefit through the link this has been discussed around the SEO circles before.
For example if you check the example link on the TinyURL homepage, it points to an Ebay page and this Ebay page is PR0 despite being on the TinyURL homepage for a very long time.
So i suggest you don't drive links to your site through a TinyURL link you will lose the benefits.
just harvested 30,423 links when i loaded the list inside comment poster only 2,223 load up to post to, DO I have settings I need to change? I seen my other 3 post about this got lost in the thread
VinnyChase, where do i begin.. In your 4 or 5 posts there's about 50 questions and problems with almost every feature the tool has. First up have you read the documents?
What out of all the above have you not worked out yet? Your domains "disappearing" i don't see how this could happen without manual intervention of some sort. Have you added domain to the backlist.txt file? This will remove domains, so you don't wind up spamming Matt Cutts blog or something silly like that.
Also the best and fastest way to get support is
this. With an exchange of screenshots and your data files so i can see what's going on, every one of your problems would likely be fixed very easily. About 80-90% of problems are a result of loading wrong/corrupt/malformed files, and in the case of a tool bug it's fixed same day and often with the hour. Several times i've even sent special builds to people to try and solve one off problems only effecting their machine. There's not much that cannot be fixed.
i think sweet is busy, maybe with thanksgiving or weekend..
What's these "weekends" you speak of?
