1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Any good tools to extract urls from Google?

Discussion in 'Black Hat SEO Tools' started by mightybh, Mar 22, 2008.

  1. mightybh

    mightybh Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 27, 2008
    Messages:
    1,029
    Likes Received:
    1,714
    Occupation:
    CEO
    Location:
    UK
    I need to extract around 100.000 or so urls from Google containing certain keywords. Are there any tools around i could use?

    Thanks!
     
  2. BHBodeezy

    BHBodeezy BANNED BANNED

    Joined:
    Nov 25, 2007
    Messages:
    515
    Likes Received:
    704
    We can create you a custom application if you would like, Just contact Frequency or I and leave us a detailed description of what you need and we will get back with a quote and ETA.
     
  3. mightybh

    mightybh Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 27, 2008
    Messages:
    1,029
    Likes Received:
    1,714
    Occupation:
    CEO
    Location:
    UK
    Hmmmm i don't really want to spend money on untested method. I think il grab a few thousand urls with SEO Elite or something and then if that works i may well give you a shout.
     
  4. jane78

    jane78 Newbie

    Joined:
    Feb 23, 2008
    Messages:
    24
    Likes Received:
    11
    I think Xedant Keyword Harvester can solve your problem

    If it solves ur prob. and u want it let me know i'll post for you
     
  5. suade

    suade Regular Member

    Joined:
    Jul 7, 2008
    Messages:
    313
    Likes Received:
    169
    Occupation:
    Bummer
    there is one email bussiness url collector
    just search it here:D i forgot the thread
     
  6. general_z

    general_z Junior Member

    Joined:
    Aug 12, 2008
    Messages:
    120
    Likes Received:
    32
    I've been looking for a good URL collector too. Linkwhore URL harvester just gets one temp-banned from google (even with the delay) and the one i'm currently using also gets one temp-banned from google (Web Data Extractor 7.1) .. however WDE is way faster then LinkWhore but does also include a lot of useless google/yahoo/etc -URLs.
     
  7. sendlerad

    sendlerad Regular Member

    Joined:
    Sep 5, 2007
    Messages:
    307
    Likes Received:
    51
    quite slow and buggy i tryed it today but it insteed of my provided keyword list made his own so all harvested urls was useless..:(

    anyway there must be some other tool any advice?
     
  8. shehzada4

    shehzada4 Regular Member

    Joined:
    Sep 12, 2010
    Messages:
    228
    Likes Received:
    173
  9. soma56

    soma56 Regular Member

    Joined:
    Jun 16, 2009
    Messages:
    276
    Likes Received:
    154
    Home Page:
    Malwarebytes automatically blocked this URL? Also, this post is like 3 years old...
     
  10. wes_one

    wes_one Junior Member

    Joined:
    Apr 25, 2011
    Messages:
    176
    Likes Received:
    75
    Ok here is the deal.Google is becoming a faggot aka it is starting to get really hard to extract big amounts of links from google.Thats is why I recomand some other search engines like badui,sky.com,yandex etc.

    Also there are over 10 different "google enhanced" search engines online that do not ban by ip if you scrape nor you need to use proxy to scrape from them and they still give you the result from google aka they retrieve google result for you.

    You should check out list of search engines that Hrefer has,it is pretty awesome list witch you could implement with Zennoposter by making some simple template for extracting links.I say this about Zenno because I noticed that many of these "google enhanced" search engines have very simple source code unlike google and the result could be parsed with only few regex matches.

    Or you could go to freelancer or odesk and higher a programmer that will probably satisfy your needs.
     
  11. Carlmarks

    Carlmarks Newbie

    Joined:
    Nov 22, 2011
    Messages:
    31
    Likes Received:
    0
    U can use this software for your work

    URL, Meta Tag Extractor Module.
     
  12. lazaraus

    lazaraus Newbie

    Joined:
    Jan 27, 2008
    Messages:
    3
    Likes Received:
    1
    Recently my affiliate discovered the traffic i was sending was coming from a redirect URL[through a cloaked site].Redirects are against their terms of service and now my sales and commissions are a big 0.I s there any way i can trick them into thinking my traffic is coming directly from my referral URL?
     
  13. The SEO

    The SEO Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 14, 2011
    Messages:
    3,973
    Likes Received:
    3,114
    Occupation:
    SEO/SMM
    Location:
    BHW
  14. Cleverchristopher

    Cleverchristopher Registered Member

    Joined:
    Nov 12, 2012
    Messages:
    73
    Likes Received:
    62
    Occupation:
    Professional SEO
    Location:
    Seattle
    Ubot works pretty well for this - has a bit of a learning curve, but the new version does a good job, plus you can drop the results directly ito a database which is very useful.

    Ubot is not the most stable software outthere - it tends to crash more than I like but it does a good job.
     
  15. tweakcoder

    tweakcoder Regular Member

    Joined:
    Apr 8, 2012
    Messages:
    238
    Likes Received:
    184
    Occupation:
    PHP Web Developer
    Location:
    India
    ScrapeBox
     
  16. PeaceLoveSubmission1

    PeaceLoveSubmission1 Regular Member

    Joined:
    Sep 30, 2011
    Messages:
    482
    Likes Received:
    256
    Guys do you not see when the op posted this? Im sure he knows about scrapebox by now.....
     
  17. poola

    poola Junior Member

    Joined:
    Jul 26, 2008
    Messages:
    148
    Likes Received:
    35
    A lot of questions should not be coming up if guys can learn everything about scrapebox. There is a reason why many serious IM consider it a tool you cannot do without if you are serious in this biz.