- Jan 25, 2009
- 6,378
- 3,774
Would love some input from the greatly respected members on this page...alaltaierii, loopline, proxygo
From what i understand, the Blacklist will not only keep you from posting to specific urls, but it will also keep you from harvesting the same url again.
I'm pondering the thought to add my master list of harvested urls to the Blacklist so i don't harvest the same url twice. Seems like it would save a lot of time.
Can you guys shed some light on this topic? Does anyone recommend or not recommend this for any reason?
The blacklist is for scraping, not posting. So if you have sites in the blacklist they won't be scraped from the engines with the harvester, so you wouldn't be posting to them, because they aren't in the list.
If you grab someone elses list and load up and go and the urls are in the blacklist, then it would still post to them. Assuming though, that the lists were scraped with scrapebox, it wouldn't be an issue because everyones cloud blacklist is the same.
As for adding the urls you have already scraped to the blacklist. My 2 cents - I wouldn't do it.
I have been there and done that and the blacklist gets huge to manage. Plus your wasting a lot of processor usage (which is irrelevant if you aren't maxing it, but still it could lead to a scrapebox lockup) checking every url that is harvested against a list of hundreds of thousands of urls, if not millions of urls.
Sure the url won't be added to the list of harvested, but you still had to pull the google results page that it was on, just scrapebox is filtering out the urls you don't want. So its not saving any bandwidth, or requests to the engine, its just filtering what it gets back.
It would be far more efficient to scrape your list as is, and then use the import and compare on url or domain feature. Then choose the lists that you have previously scraped.
At the end of the day either method will get the job done, but I personally prefer to not use the blacklist method. Your call, no wrong answer.
I just got SB a short time a go and I am suing private proxies.I made a few blasts -no more than 6 - and 40G of bandwidth is gone!!!
How do you handle this? Do I need a vps? I am not sure that I am willing to invest more on SB as I did not see any benefits for using it yet.
Well what is the issue? If its bandwidth then yeah, you are going to want a VPS. You have to consider the fact that if you are posting to and then link checking pages that are 10MB each or something, that you can suck bandwidth quick.
If you want a quicker, less bandwidth intensive approach, you may be better off to take the money you would spend on a vps each month, and buy a couple of auto approve lists. Then you are getting the most links the fastest with minimal bandwidth.
Hey Loopline, I checked out some of your videos and I have better understanding of the scraping process watching your footprint video so I now know I was making some errors using allintitle with invalid parameters .
The only question I have now is the second part of my original question.
Question: When backlinking am I meant to comment on both relevant and irrelevant blogs using both AA lists and High PR blogs? cos I scraped over 40k blogs with about 100 PR 6,5,4,3 combined?
Please advice thanks
Sure, I comment on everything. Everything. Its perfectly natural to have links coming from unrelated sites. I mean, unless you just turned your site on yesterday and don't want it lit up with 10K links by tomorrow, then comment on it all. Auto approve is typically 2% or less, and the rest, you might get (at most I would bet) 10% of moderated approved, and thats if you have great comments.
Again, no wrong answer though, you decide how heavy you want to go in.
I just got my VPS today and I'm trying to transfer my license from my home machine to it. When I click the Activate button I don't seem to get the checkbox to request the license transfer. How can I get it transferred?
The took away the transfer option. They can tell if its a transfer or a new activation without it.