Any good tools to extract urls from Google?
- Thread starter mightybh
- Start date
I've been looking for a good URL collector too. Linkwhore URL harvester just gets one temp-banned from google (even with the delay) and the one i'm currently using also gets one temp-banned from google (Web Data Extractor 7.1) .. however WDE is way faster then LinkWhore but does also include a lot of useless google/yahoo/etc -URLs.
- Sep 5, 2007
- 2,410
- 702
there is one email bussiness url collector
just search it herei forgot the thread
quite slow and buggy i tryed it today but it insteed of my provided keyword list made his own so all harvested urls was useless..
anyway there must be some other tool any advice?
soma56
Regular Member
- Jun 16, 2009
- 275
- 158
Malwarebytes automatically blocked this URL? Also, this post is like 3 years old...
Ok here is the deal.Google is becoming a faggot aka it is starting to get really hard to extract big amounts of links from google.Thats is why I recomand some other search engines like badui,sky.com,yandex etc.
Also there are over 10 different "google enhanced" search engines online that do not ban by ip if you scrape nor you need to use proxy to scrape from them and they still give you the result from google aka they retrieve google result for you.
You should check out list of search engines that Hrefer has,it is pretty awesome list witch you could implement with Zennoposter by making some simple template for extracting links.I say this about Zenno because I noticed that many of these "google enhanced" search engines have very simple source code unlike google and the result could be parsed with only few regex matches.
Or you could go to freelancer or odesk and higher a programmer that will probably satisfy your needs.
Also there are over 10 different "google enhanced" search engines online that do not ban by ip if you scrape nor you need to use proxy to scrape from them and they still give you the result from google aka they retrieve google result for you.
You should check out list of search engines that Hrefer has,it is pretty awesome list witch you could implement with Zennoposter by making some simple template for extracting links.I say this about Zenno because I noticed that many of these "google enhanced" search engines have very simple source code unlike google and the result could be parsed with only few regex matches.
Or you could go to freelancer or odesk and higher a programmer that will probably satisfy your needs.
Recently my affiliate discovered the traffic i was sending was coming from a redirect URL[through a cloaked site].Redirects are against their terms of service and now my sales and commissions are a big 0.I s there any way i can trick them into thinking my traffic is coming directly from my referral URL?
Cleverchristopher
Registered Member
- Nov 12, 2012
- 73
- 62
Ubot works pretty well for this - has a bit of a learning curve, but the new version does a good job, plus you can drop the results directly ito a database which is very useful.
Ubot is not the most stable software outthere - it tends to crash more than I like but it does a good job.
Ubot is not the most stable software outthere - it tends to crash more than I like but it does a good job.
tweakcoder
Regular Member
- Apr 8, 2012
- 238
- 187
ScrapeBox
PeaceLoveSubmission1
Regular Member
- Sep 30, 2011
- 480
- 261
Guys do you not see when the op posted this? Im sure he knows about scrapebox by now.....