URL Scraping Tool

[irfanlone]

Can anyone here recommend a good scraping tool.I used to work with Scrapebox in the past,but their URL harvestor isn't working the way it used to, in the past.I even have GScraper,but heard some bad things about it,so i doubt it might not be working.Any suggestions in this regard would be appreciated.

 

[bluecoder]

As per the market and past, scrapebox is best even am using in my daily work hope most of them too...so what your actual requirement so we can suggest based on that...

 

[irfanlone]

There is some issue with URL harvestor,it only spits errors.Now don't tell me the proxies are bad or something as i have been using the same proxies in the past with Scrapebox,but less productive today.

 

[bluecoder]

Yes Google as u know they are very keen in noticing and making changes frequently...try Bing n Yahoo it will give good results...and try Google search API in engine selection...even for me sometimes I noticed Google will not give much results....

 

[smarty84]

Hi, I also think that the scrapebox is best. I hope someone here can help you with the issue that you are facing with the scrapebox.

 

[irfanlone]

Yes Google as u know they are very keen in noticing and making changes frequently...try Bing n Yahoo it will give good results...and try Google search API in engine selection...even for me sometimes I noticed Google will not give much results....

How many threads should i use with 10 proxies or should i use the proxies provided by Scrapebox?

 

[irfanlone]

I made the changes in the setting but still getting errors even using Yahoo and Bing search engines.However one thing i forgot to mention is that i am using site operator,but i don't think it make such a big difference.

 

[DunDidIt2X]

Not sure what you are trying to actually do, but you might be interested in the tools at the site in my sig. A Couple different scrapers.

 

[irfanlone]

Not sure what you are trying to actually do, but you might be interested in the tools at the site in my sig. A Couple different scrapers.

Main purpose is for URL harvesting.

 

[Kamrul Ahsan]

scrapebox is the best mat

 

[bartosimpsonio]

Scrapebox and GScraper both do the job. If there's errors then save the messages and contact their support, they'll tell you what's wrong. Something must be wrong with your footprint or you need to update SB or GS to get the latest search engine profiles.

 

[DunDidIt2X]

Main purpose is for URL harvesting.

Yes there are a few applications there that do url harvesting.

 

[irfanlone]

Scrapebox and GScraper both do the job. If there's errors then save the messages and contact their support, they'll tell you what's wrong. Something must be wrong with your footprint or you need to update SB or GS to get the latest search engine profiles.

I already send a ticket,waiting for their reply.How many proxies are you using? and how many urls are you able to scrape?.

 

[BackY]

When the fuck are u going to learn to use punctation????? FFS

 

[extremeboy]

you will need better dedicated proxies and it should be fine with SB or GSc

 

[JustUs]

I just checked Gscraper. Bing works, Google does not.

 

[irfanlone]

I just checked Gscraper. Bing works, Google does not.

Good to hear that..

 

[irfanlone]

Could anyone tell me how to filter keywords, by the number of words it has.Scrapebox generates keywords that has well over 10 words,which i don't need.Kindly tell me how to do that.

 

[proxygo]

the only problem with gscraper is there is 0 support
no update since march - so if it works use it, if not dont
bother there support they reply to no1

 

[irfanlone]

the only problem with gscraper is there is 0 support
no update since march - so if it works use it, if not dont
bother there support they reply to no1

It is kinda funny.I deleted my ScrapeBox copy and download it again, and after updating, it seems to work fine for atleast Bing and other search engines.There must have been some corrupted file in my ScrapeBox folder.