New ScrapeBox Public Beta: What do you guys think?

[Istenais]

Why I can't press any button, it just doesn't work for me or I need license to BETA-test it, lol?

 

[Aty]

Sweet baby Jesus, finally!

 

[Sweetfunny]

I had cut the log file down to the issues that were actually present rather than include the entire file. I did this to save you time. If you are anything like me, you absolutely hate digging through logs looking for errors. I left 500 and 503 errors because they often indicate server configurations errors. As an example of this here is an entry from the proxy manager log

2/3/2015 3:29:34 AM: HTTP: 500 , SOCKET: Connection refused, Proxy: 107.23.43.44:80, Judge: http://www.sbjudge3.com/ip4.php

Your judge, sbjudge3, refused the connection. This could be overload, though the error logs will generally indicate too many connections, a misconfiguration, or some other unspecified server error.

I tried connecting to numerous sites through this proxy in other tools, and raw socket tools and they all said the same as ScrapeBox, connection refused.

A 407 error is not always a private proxy. 407 is the same error that you receive when the SSL/TLS certificate is missing or does not match. As an example:

2/3/2015 3:29:57 AM: HTTP: 407 Proxy Authentication Required, SOCKET: , Proxy: 94.182.162.242:8080, Judge: http://www.sbjudge1.com/ip4.php

This one was scraped with SB and most likely not a private proxy. However, when I feed SSL proxies into SB and test them with SB the same error is received. The bad part is that I had already tested the proxy with my proxy tester and know that it is not a private proxy. If I turn off the SSL in my proxy tester, I also receive a 407 error because of the inability to to validate the required SSL/TLS certificate. I even sent you the C# code that I use to approve certificates to show that all certificates are accepted. The reason I tested this is because you have added the SSL libraries.

Yes there's a few causes for a 407 but almost always, it's because the proxy requires authentication via a user/pass or by saving your real IP in the proxy servers configuration to allow access.

See here a connection through 94.182.162.242:8080: http://i.imgur.com/lD0QdLh.png

This proxy you said your tester marked as good, i have tried connecting through it to sites such as Wikipedia, YouTube, Ebay etc in both http and https using a number of tools to completely rule out ScrapeBox and the ScrapeBox judges. All the time 407 and you can see the proxy is running Squid which is returning

<p>Sorry, you are not currently allowed to request http://en.wikipedia.org/wiki/Hypertext_Transfer_Protocol from this cache until you have authenticated yourself.</p>

The server is telling me i need to be authenticated, this is in another tool that has nothing to do with ScrapeBox but it's giving the same result as ScrapeBox. This is where i ended up last time, i did sink hours in to trying to create a problem but couldn't so it become time to move on to more pressing issues to get v2.0 finished.

Yes, Gscraper can post comments. However there are some serious problems with the poster. You can use the poster to post a comment to a perfectly clean and unspammed site in your control with GScraper. Within days, sometimes hours, you start finding numerous other people spamming the site. The sites I tested this on were my own sites, and unscraped with GScraper and the search engines were blocked in htaccess; the sites were just loaded from a file. Make of it what you will. I will say that anyone that uses the GScraper poster should not expect the sites posted to to remain private because everything is bounced off the servers in China even though the post and tests are conducted from the local computer. When you purchase the proxy service from GScraper, the proxies are pretested for anonymity, but do not expect your posts to remain private. Yes, GScraper will leak your IP if you are posting and using public proxies to do so. How the Gscraper proxy tester works is that the proxy end points are set up and then a test is made against a Google page and a string is looked for. If the string is present, the proxy is considered good, anonymity is never tested.

Yes i read someone say the same thing about their own proxies they created and used in GScraper, their proxy server started getting hits from China. If they sell AA lists and proxies, these have to come from somewhere i guess but i wont speculate on that.

ScrapeBox is a far superior product. You are not passing large amounts of encrypted data back to your servers, even in the beta I have seen no sign of telemetrics. They might be present, but I have never seen the need to even check with wireshark. You validate at boot and that is about it unless there is a reason to use your servers such as proxy checking, and even then I don't think you are doing anything but testing the anonymity. With your new framework (which I am curious which product you are using) you have overcome the socket hanging problem that plagued SB V1. With that framework, from observation, you could probably bump the number of proxy testing threads up over 200 with little problem.

Thanks and no, we dont send any data about a persons usage, sites, lists etc. I prefer it that way.

It says It is missing an activation. So it it still open to use?

Yes you just need a valid ScrapeBox v1 license on the PC you wish to use v2 and it should work without having to do anything, you can run v1 and v2 at the same time.

I haven't used SB for a couple of years now probably.. Looks like I will have to start using it again. 250k urls per minute is huge IMO..

SweetFunny, you should send out a mailing for this. If I haven't seen this thread I wouldn't even know that V2 exists

Thanks, at the moment though it's still not complete and we have opened a beta for people to try. When the v2.0 final is released i'll let everyone know it's available.

 

[rogerke]

You mean like once harvesting is done the grid that lists all the urls harvested, under the "urls harvested" section? You can right click and copy the urls to clipboard. I mean you have to highlight the ones you want using the shift key and clicking at the topmost url and bottom most url, but then you can copy to clipboard. Im confused, what are you saying?

Yes that's what I mean. In the old version you have export list> copy all URLs to clipboard, which makes it a little bit faster. For most people it isn't an issue at all, but since I'm loading and sorting URL lists numerous times a day, I prefer the old SB for now.

 

[JustUs]

I tried connecting to numerous sites through this proxy in other tools, and raw socket tools and they all said the same as ScrapeBox, connection refused.



Yes there's a few causes for a 407 but almost always, it's because the proxy requires authentication via a user/pass or by saving your real IP in the proxy servers configuration to allow access.

See here a connection through 94.182.162.242:8080: http://i.imgur.com/lD0QdLh.png

This proxy you said your tester marked as good, i have tried connecting through it to sites such as Wikipedia, YouTube, Ebay etc in both http and https using a number of tools to completely rule out ScrapeBox and the ScrapeBox judges. All the time 407 and you can see the proxy is running Squid which is returning

Let me ask this: have you checked the socket error codes? When SSL validation fails your socket should return, I believe out of memory, 1135.

I am aware that some sites require your IP be stored on their server. That is not really the issue though I am trying to find a way around that for my own use.

When I have the time, I will recreate the problem, but I am not currently very concerned about it. Pain from medical issues and a few other fires...

 

[spectrejoe]

Is there a tutorial on how to scrape efficiently with scrapebox to find high pr backlinks?

Wanted to get some relevant backlinks but I'm a total newb when it's about scrapebox, have had it for 3 years didn't use it a single time successfully most of the times due to proxies

 

[HelloInsomnia]

Yes that's what I mean. In the old version you have export list> copy all URLs to clipboard, which makes it a little bit faster. For most people it isn't an issue at all, but since I'm loading and sorting URL lists numerous times a day, I prefer the old SB for now.

You can right click and copy to clipboard in V2 that is what he is trying to tell you - that is is possible.

 

[HelloInsomnia]

Is there a tutorial on how to scrape efficiently with scrapebox to find high pr backlinks?

Wanted to get some relevant backlinks but I'm a total newb when it's about scrapebox, have had it for 3 years didn't use it a single time successfully most of the times due to proxies

Here you can find almost anything: https://www.youtube.com/user/looplinescrapebox

But start here for what you want specifically:

 

[spectrejoe]

Here you can find almost anything: https://www.youtube.com/user/looplinescrapebox

But start here for what you want specifically:

Thanks Insomnia

 

[rogerke]

You can right click and copy to clipboard in V2 that is what he is trying to tell you - that is is possible.

I know - it's just that I prefer the export list>copy option. A little nitpicking, but enough reason for me to keep using V1. YMMV.

 

[HelloInsomnia]

I know - it's just that I prefer the export list>copy option. A little nitpicking, but enough reason for me to keep using V1. YMMV.

Did you send support a request? I am sure they will add it in for you. This is a beta version after all I think some people maybe don't quite get what that means..

 

[softtouch2009]

I know - it's just that I prefer the export list>copy option. A little nitpicking, but enough reason for me to keep using V1. YMMV.

This feature was added today to the grid popup menu and to the Export Url Lists button and will be available in the next beta.

 

[PopularPlayer]

Love how the UI is still the same - the retro looks makes me warm and fuzzy inside haha - keep up the good work guys, need to find my Scrapebox licence then

 

[race2go]

I have a question,I notice on the latest scrapebox v2 beta update it says that the google engine time span 24hr,week,month has been added but its don't appear to be on the front like v1, do anybody know how and where to access it?

 

[Sweetfunny]

Love how the UI is still the same - the retro looks makes me warm and fuzzy inside haha - keep up the good work guys, need to find my Scrapebox licence then

Yes, there's thousands of people who have used ScrapeBox that much over the last 5 years that the button clicks are ingrained in their muscle memory lol. Also there's so many tutorials, guides, videos, blog posts out there people have made showing how to do various things. So by not departing too much from the original concept people can hit the ground running without much learning curve, and most the resources are still relevant.

Also i'll post this here too since a number of these feature were requested in this thread:

ScrapeBox v2.0.0.28 Beta Released

• Added notification email when proxy tester completed
• Added Trim to Last Folder
• Fixed a bug in Import and compare on domain level
• Fixed a bug when clicking "Edit" under the proxy memo and typing non proxy values
• Fixed a bug in Poster when a gzip compressed tcp data was in fact not gzip compressed
• Fixed a bug in keyword scraper causing automator to stop due to a dialog popup
• Added to Proxy Manager "Load from ClipBoard", "Append from ClipBoard" and "Save to Clipboard"
• Added "Default Export File Format" to Options menu
• Added "Copy all URLs to Clipboard" to grid popup menu and "Export Url Lists"
• Added Google timespan engines for 24h, Week, Month, Year
• Fixed Enhanced Google engine
• Added option to change Captcha Sniper port

Just a few notes, to update the default search engines you can do this at any time by going to Settings >> Harvester Engines Configuration >> Import >> Download Default Engines From Server.

With the Google Timespan engines as individual engines, you can harvest from 24hr, Week, Month, Year at the same time with the same keywords giving more diversified and unique results.

Also the option to change the Captcha Sniper port, you only need to do this if Captcha Sniper is giving you a warning that another server is listening on this port when you use the default Port 80. Since Captcha Sniper emulates De-Captcher.com on port 80, if you are running Skype, IIS, Xampp etc at the same time it wont work. So now you can run SB and CS on another port such as 81 while another server runs on Port 80.

This is the settings to make both work:
View attachment 60288

 

[HelloInsomnia]

I have a question,I notice on the latest scrapebox v2 beta update it says that the google engine time span 24hr,week,month has been added but its don't appear to be on the front like v1, do anybody know how and where to access it?

Go to settings then harvester engine configuration then make sure you export any custom engines you have if you don't want to lose them. Then click on import and select download default engines from server.

Now when you use the custom harvester you will see them there.

 

[bokeboke]

Love it. Now I'm no stuck at 1 million urls.

 

[Jungle123]

Scrapebox sitemap scrape addon:

Can not scrape sitemap from https protocol websites. As you guys might understand - every reputable website is having https for at least last 5 years and luck of this feature has been problem with Srapebox in V1 and now is the same in V2.
Any ideas if that will be fixed?

 

[softtouch2009]

Scrapebox sitemap scrape addon:

Can not scrape sitemap from https protocol websites. As you guys might understand - every reputable website is having https for at least last 5 years and luck of this feature has been problem with Srapebox in V1 and now is the same in V2.
Any ideas if that will be fixed?

Give me an example site which has a sitemap, is https and does not work.

 

[Jungle123]

Give me an example site which has a sitemap, is https and does not work.

You have got pm

regards,
J