Permanently Closed Marketplace Sales Thread

Status
Not open for further replies.
Long story short I cant scrape G more thean xx.xxx urls . I use private proxies and same config i use since last year when I could scrape millions in less than 24h. I changed proxies, i trid to scrape without proxies, i changed settings nothing worked.

I have a 1Gps internet connection and a dedi machine just for scrapping no antivirus or other software that may interfere . I emailed support 2 weeks ago i didnt got any answer. Anyone alse experience this. I see thatt Gscraper user have the same problem.

Just in addition to the suggestions Loopline gave, ScrapeBox also has ~25 or so other search engines besides Google and you also have the ability to modify or train new engines from scratch. You can change everything about the Google harvester, you can change the useragent to a mobile phone or tablet, you can use http or https, add custom cookies to the request, change the referrer, completely change the URL parameters and so on.

So you are not stuck with a hard coded scraper that only works with Google, it's worthwhile checking out other engines to supplement Google. Proxies are easier to come by too, because you don't need "Google Passed' proxies for other engines.

Possible Bugs: Dropbox Cloud Storage Login Screen Cannot Proceed with login. I'm talking about the Authorize Windows after giving app key and secret info to authenticate with dropbox. Upon navigating from the internal browser to dropbox homepage, dropbox says the browser isn't supported. Onedrive On Onedrive, after giving app key and secret, a blank screen shows up and nothing happens. Both happen on version v2.0.0.48

Thanks for the report, this is fixed in v2.0.0.49

I bought it at price of $57 two months before can i get again on this price?

If your an existing custom and want to purchase additional licenses, please email support http://www.scrapebox.com/contact-us
 
Possible Bugs: Dropbox Cloud Storage Login Screen Cannot Proceed with login. I'm talking about the Authorize Windows after giving app key and secret info to authenticate with dropbox. Upon navigating from the internal browser to dropbox homepage, dropbox says the browser isn't supported. Onedrive On Onedrive, after giving app key and secret, a blank screen shows up and nothing happens. Both happen on version v2.0.0.48

OneDrive / SkyDrive: Click your APP ID at https://account.live.com/developers/applications/index, then select "Edit Settings", then click on the left side "API Settings" and make sure that "Mobile or desktop client app" has YES checked, its now by default NO which will cause a blank authorization screen.

DropBox: I have no problem using dropbox. Try to use your system browser, and go to https://www.dropbox.com/developers/apps and create your key/secret.
 
Thanks, I managed to solve onedrive, it was really disabled and I forgot to enable it. I cannot click the login button on the dropbox auth screen on scrapebox's inbuilt browser. It just won't happen. I've done this before and it worked. Now, I can't login from scrapebox to make the auth connect. So, it's something to do with that browser. I can click on login like mad and it just won't accept my clicks.
OneDrive / SkyDrive: Click your APP ID at https://account.live.com/developers/applications/index, then select "Edit Settings", then click on the left side "API Settings" and make sure that "Mobile or desktop client app" has YES checked, its now by default NO which will cause a blank authorization screen. DropBox: I have no problem using dropbox. Try to use your system browser, and go to https://www.dropbox.com/developers/apps and create your key/secret.
 
ScrapeBox v2.0.0.49 Released

  • Optimized harvester code to lower CPU usage
  • Added adjustable connections to Meta grabber
  • Added adjustable connections to URL Shortener
  • Addon: Sitemap Scraper fixed
  • Addon: WhoisScraper - blacklist added to filter registrant names and/or email addresses
  • Addon: Google Competition Addon updated
  • Addon: Redirect Check Addon added (NEW)
  • Addon: Page Authority Addon updated
  • Addon: Article Scraper fixed
  • Plugin: Article Scraper fixed
  • Plugin: Export as xlsx added to Malware and Phishing filter in Automator

The full ScrapeBox v2.0 changelog can be viewed here http://www.scrapebox.com/scrapebox-v2-changelog
 
Hey sweet,

Will scrapebox work on windows 10? if not now will it in future?

The pc i got scrapebox on is possibly finished, ive been having cpu issues and after trying multiple things i think it may be some corrupted file or something, so im considering upgrading to windows 10 in the hope it resolves my problem.
 
Hey sweet,

Will scrapebox work on windows 10? if not now will it in future?

The pc i got scrapebox on is possibly finished, ive been having cpu issues and after trying multiple things i think it may be some corrupted file or something, so im considering upgrading to windows 10 in the hope it resolves my problem.

ScrapeBox works fine on Windows 10
 
By default 33 footprints are appearing while harvesting. Is there any way to disable that.
 

Attachments

  • scrapebox.PNG
    scrapebox.PNG
    60.2 KB · Views: 54
Does SB have addon which shows you how many searches a url gets per month?
 
Do you accept adult niches as well?

Scrapebox works in any niche.

Does SB have addon which shows you how many searches a url gets per month?

No. But are you talking about what like site: ? I mean you said how many searches a url gets not a keyword, or did you just mean general search volume etc.. ?

Either way the answer is no, but I wanted to make sure I understand what your saying to see if maybe you mean something else and there is another way to do it.
 
hello loopline,
is that possible to remove root domain only from harvester list ?
or detect it's available to post or trackback with scrapebox ?
thank you
 
hello loopline,
is that possible to remove root domain only from harvester list ?
or detect it's available to post or trackback with scrapebox ?
thank you

There is no tool that removes only a root domain. Also you don't need to detect if its able to work with a trackback or post, its quicker to just run it thru the poster/trackback submitter. Because checking to see if it can accept it will take just as long or longer then running it thru the poster/submitter its self, plus then you would have to still go back and submit to the ones that can and its a seperate process, which over complicates things and takes more time.

So I just run them thru.
 
Version .49 - bug with CPU usage is still there....

8wMWOb8
 
Version .49 - bug with CPU usage is still there....

In your screenshot you you running 1,079 connections with only 310 proxies, so each proxy is doing 3 concurrent searches. Also your errors equate to about 8 errors/retries per second. Is this configuration what your actually trying to harvest with, or just something you are doing to try and make the harvester fail?

What happens if you back the connections of to say 300 with your 310 proxies?
 
In your screenshot you you running 1,079 connections with only 310 proxies, so each proxy is doing 3 concurrent searches. Also your errors equate to about 8 errors/retries per second. Is this configuration what your actually trying to harvest with, or just something you are doing to try and make the harvester fail?

What happens if you back the connections of to say 300 with your 310 proxies?

No matter how many proxies i use (300-2000), what settings i use i will always get 100% cpu usage with 1k threads (1 instance or 10 instances at 100 threads). Even if CPU usage would be 25-30% with 300 threads its too much as its dedicated server, not VPS. One instance of version .39 dont use 5% cpu on this server with 1k threads. Im not trying to make harvester fail, im trying to show you that there is still bug.


His brain has problems obviously. Even shitty than his junk server.
So Xeon 1650 dedicated server is shitty server? Cmon bro tell us more about servers, it looks like you are expert :D
 
No matter how many proxies i use (300-2000), what settings i use i will always get 100% cpu usage with 1k threads (1 instance or 10 instances at 100 threads). Even if CPU usage would be 25-30% with 300 threads its too much as its dedicated server, not VPS. One instance of version .39 dont use 5% cpu on this server with 1k threads. Im not trying to make harvester fail, im trying to show you that there is still bug.



So Xeon 1650 dedicated server is shitty server? Cmon bro tell us more about servers, it looks like you are expert :D

Must be related to your computer. I run it with 300 threads, using also Bing like you, and get 0%-1% cpu only

x6NCnsN
 
constantly buggy overloaded server
Prove me that my server is buggy, than say its buggy.

I'm more a scrape app expert
2000 proxies run 500-1500 threads
1.5k proxies, 5k threads and its working. I could lanuch 3 total instances with these proxies and it still would be working. You know nothing about harvesting.

GAH6kjp
 

Attachments

  • GAH6kjp.jpg
    GAH6kjp.jpg
    37 KB · Views: 44
Hey.

In latest v.2.x.x.x.49, during completed Proxy Manager, I can't select all via ctrl + shift.
 
Last edited:
Status
Not open for further replies.
Back
Top