Permanently Closed Marketplace Sales Thread

Status
Not open for further replies.
Hi.... This is my first post in this thread. although i bought this software long time ago.. lol...

Quick question:
i have 550 private proxies, 1 sb instance, 1GBPS, Dual Xeon 16GB Ram, bandwith is not a problem.

i want to harvest arround 300k keywords. (yes i mean 300,000 keywords)

Gimme best setting for this please....
do i need to separate the keywords to 10k each harvesting session?
how many connection is the best for google, bing, and yahoo?

Thank you!
 
Hi.... This is my first post in this thread. although i bought this software long time ago.. lol...

Quick question:
i have 550 private proxies, 1 sb instance, 1GBPS, Dual Xeon 16GB Ram, bandwith is not a problem.

i want to harvest arround 300k keywords. (yes i mean 300,000 keywords)

Gimme best setting for this please....
do i need to separate the keywords to 10k each harvesting session?
how many connection is the best for google, bing, and yahoo?

Thank you!

No, you don't need to separate keywords, unless your sever is already capped out on resources. It can handle 300K easy, Ive done much more then that. However I guess it depends on what exactly are the keywords, but just load them up and try it, you shoudl be fine.

Why on earth do you have 550 Private proxies? I am a scrapebox mad man, lol but I only have a couple of hundred ish. But anyway set your connections to 10%-20% of your proxies. So set connections to 55 or 110 or somewhere in between. Then let it rip and you should be good. Google is usually good with the 20% mark for basic keywords and 10% for advanced operators. Bing and Yahoo Ive not tested that heavily as to know exactly but 10% should do you good.
 
1. In the automator plugin for the option to generate emails it does not let me input anything in "Domain for emails" and nothing in the drop down option either. 2. In the harvest keywords option it says "Leave blank when keyword harvester is used"... which does not make sense... how is it going to harvest any keywords if I don't input a seed keyword? Any forum for bug reports like these?
 
1. In the automator plugin for the option to generate emails it does not let me input anything in "Domain for emails" and nothing in the drop down option either. 2. In the harvest keywords option it says "Leave blank when keyword harvester is used"... which does not make sense... how is it going to harvest any keywords if I don't input a seed keyword? Any forum for bug reports like these?

1) It will get the email domains you setup in ScrapeBox -> Menu Tools -> Open name & Email Generator.
2) Its a mistake and should read "leave blank when keywords in "Harvest keywords" are used. Thats fixed in the next version.
 
No, you don't need to separate keywords, unless your sever is already capped out on resources. It can handle 300K easy, Ive done much more then that. However I guess it depends on what exactly are the keywords, but just load them up and try it, you shoudl be fine.

Why on earth do you have 550 Private proxies? I am a scrapebox mad man, lol but I only have a couple of hundred ish. But anyway set your connections to 10%-20% of your proxies. So set connections to 55 or 110 or somewhere in between. Then let it rip and you should be good. Google is usually good with the 20% mark for basic keywords and 10% for advanced operators. Bing and Yahoo Ive not tested that heavily as to know exactly but 10% should do you good.

THank you! i tried it first with 50 connections but it only harvest arround 50 url/s max. i lowered the connection to 25 then i got 400 error after it scrape arround 400k urls.
 
I did harvesting only arround 1000 keywords with 550 private proxies, connections 50 google, 50 yahoo...

after i saw the harvester seems slow, i change the connection to 25 google, 25 yahoo.
after i harvest arround 15 minutes, i got an error 400 with google and error 999 with yahoo....
and the connections are decreasing from 25 to 0 connection. is there something wrong?

I use this operator site:something.com "profile" keyword

please advice.
 
I did harvesting only arround 1000 keywords with 550 private proxies, connections 50 google, 50 yahoo...

after i saw the harvester seems slow, i change the connection to 25 google, 25 yahoo.
after i harvest arround 15 minutes, i got an error 400 with google and error 999 with yahoo....
and the connections are decreasing from 25 to 0 connection. is there something wrong?

I use this operator site:something.com "profile" keyword

please advice.

The 999 error is yahoo banning your IP. That is an "advanced operator", it uses more of the engines resources to generate the response, therefore they ban IPs more quickly.

Are all 550 proxies using different IPs?

Try like 5 connections as test and see what happens.

400 is not a google ip ban. That a proxy error. How many max simultaneous connections does your proxy provider allow? Are all your proxies from 1 provider?
 
The automator plugin is stuck on srcraping URLs overnight (the number of results has not changed). If I use Task Manager to shut down SB and start scraping again will it overwrite the results or append to them or better to specify new target/destination files?

Automator plugin also gets stuck on scraping proxies from a 3K list. This same list works fine when grabbing proxies manually but the automator plugin freezes (tested 4-5 times).

Also, when starting a new project can I use the same destination file/folder for all successful and failed targets and others like save comments, names, emails, etc.? Would be easier to build an AA list this way... or will starting a new project overwrite all destination files and content.

Generate names and emails does not work in automator plugin... for now I"m manually scraping them with SB and selecting the targets in post content as opposed to letting the automator plugin handle it.
 
Last edited:
The 999 error is yahoo banning your IP. That is an "advanced operator", it uses more of the engines resources to generate the response, therefore they ban IPs more quickly.

Are all 550 proxies using different IPs?

Try like 5 connections as test and see what happens.

400 is not a google ip ban. That a proxy error. How many max simultaneous connections does your proxy provider allow? Are all your proxies from 1 provider?

as far i know, error 999 is temporary ban by yahoo.

I uncheck the "use multiple connection" to try it, seems that now all engines:yahoo, google, and bing gives the same 400 error (bad request). my proxy provider allows 1000 connections per group. and all come from 1 provider under 3 different proxy servers.
 
as far i know, error 999 is temporary ban by yahoo.

I uncheck the "use multiple connection" to try it, seems that now all engines:yahoo, google, and bing gives the same 400 error (bad request). my proxy provider allows 1000 connections per group. and all come from 1 provider under 3 different proxy servers.

Well Im not 100% certain what is giving the 400 error, but its a bad request. Scrapebox is submitting the query to your proxy, which should pass to the engine and then back thru the proxy to you. When it comes back the request has a 400 attached. Engines aren't giving this error, at least not from data that is sent via scrapebox.

The data is either being altered after it leaves scrapebox or its never making it to the engine. So it could be your proxies, it could be anti virus/firewalls on your pc, it could be a firewall in your network, such as a router, it could be 3rd party security sofware like sandboxie or anything else.

The short of it is you need to add allow rules in all your security software.


A quick test would be try and restart your pc in safe mode with networking, verify that the internet works by visiting a page in a browser then try it with scrapebox. If it does not happen then its likely software on your pc. IF it does happen then its "more likely" that its in your network or the proxies them selves. However it "could" still be software on your pc.

Connecting direct to teh internet and avoiding any routers and/or taking your pc (if your able) to another ISP to test (such as a friends house or coffee shop) would be another test.

The automator plugin is stuck on srcraping URLs overnight (the number of results has not changed). If I use Task Manager to shut down SB and start scraping again will it overwrite the results or append to them or better to specify new target/destination files?

Automator plugin also gets stuck on scraping proxies from a 3K list. This same list works fine when grabbing proxies manually but the automator plugin freezes (tested 4-5 times).

Also, when starting a new project can I use the same destination file/folder for all successful and failed targets and others like save comments, names, emails, etc.? Would be easier to build an AA list this way... or will starting a new project overwrite all destination files and content.

Generate names and emails does not work in automator plugin... for now I"m manually scraping them with SB and selecting the targets in post content as opposed to letting the automator plugin handle it.

Scraped urls are saved in the harvester sessions folder. So for each new scrape a new folder is created, so its not overwriting scraped urls.

The proxies issue isn't do do with the automator. The automator only makes a list of "what to do next", once you launch a job in scrapebox the automator addon isn't doing anything, it just designs the list. Everything is executed in scrapebox the exact same as when you do it manually. Just when its done with one thing, it checks the list to see if there is something else to do next, as opposed to just stopping. (more or less).

If you choose to save a file name as xyz-successful.txt in a automator job and then your run the job it will save that file. If you run the job again, it will overwrite that existing file.


Does it ever popup with an error dialog, or is it just constantly frozen and you have to kill it? Is the window able to be moved around but the count doesn't increase or does it just say "not responding"?
 
Does it ever popup with an error dialog, or is it just constantly frozen and you have to kill it? Is the window able to be moved around but the count doesn't increase or does it just say "not responding"?

No popup. It stops responding and the count does not increase. Only happened when scraping AOL. Google and Bing work fine.

Regarding freezing/not responding when scraping and testing proxies it only happened with a list of 3K URLs. It does not happen when scraping/testing the default list. The same 3K list works fine when scraping/testing manually. I've started using private proxies with the automator plugin.
 
No popup. It stops responding and the count does not increase. Only happened when scraping AOL. Google and Bing work fine.

Regarding freezing/not responding when scraping and testing proxies it only happened with a list of 3K URLs. It does not happen when scraping/testing the default list. The same 3K list works fine when scraping/testing manually. I've started using private proxies with the automator plugin.

AOL is currently broken. I have no issue with it freezing, but its not going to bring in any urls either. AOL changes their search results all the time and it breaks the harvester.

Personally I think private proxies are better off anyway, because if just more reliable and consistent. However if your going to try and use public proxies I personally would refine my list. I can pull a couple of thousand good working proxies from 10-30 url sources, if they are good sources. Using 3K url sources and then trying to test all the results, its just a massive waste of time. My 2 cents.
 
^ Moved to private proxies.

Does SB hit the same URL multiple times? Wondering as its posting comments now and the "List Status" is 37992/274838.
 
^ Moved to private proxies.

Does SB hit the same URL multiple times? Wondering as its posting comments now and the "List Status" is 37992/274838.

It will only post once to each URL in the list.

You seem to be a little confused. The number on the right is 270k, not 27k.
 
How long should I wait activation before contact support?

If it hasn't been activated in 24 hours, then there's probably a problem.

Activation time can vary, but remember that they're all done manually and SF is in AUS and it's coming up night time there.

That said, I don't think I've had any activations/transfers that have taken more than 12 hours.
 
Status
Not open for further replies.
Back
Top