Y T Nuke  
Results 1 to 8 of 8
Soo Id like to harvest 12k url from same key phrase or more likely from ...
  1. #1
    antsaoo's Avatar
    antsaoo is offline Supreme Member
    Join Date
    Oct 2008
    Posts
    1,245
    Reputation
    143
    Thanks
    287
    Thanked 503 Times in 362 Posts

    Default Url harvesting problem

    Soo

    Id like to harvest 12k url from same key phrase or more likely from same website but google only gives up to 1000 =/ best way around this ?

  2. #2
    kouxx's Avatar
    kouxx is offline Junior Member
    Join Date
    Aug 2008
    Posts
    160
    Reputation
    13
    Thanks
    14
    Thanked 37 Times in 26 Posts

    Default Re: Url harvesting problem

    [your querry] + [keyword list]

    edit:
    hit the reputation button :P
    Last edited by kouxx; 03-25-2009 at 11:43 PM.

  3. #3
    antsaoo's Avatar
    antsaoo is offline Supreme Member
    Join Date
    Oct 2008
    Posts
    1,245
    Reputation
    143
    Thanks
    287
    Thanked 503 Times in 362 Posts

    Default Re: Url harvesting problem

    i think site doesn't matter Well i tried with Diff KW got first like 6k results, when removed duplicates had 1.9k left lol :P oh well , thats a start.

  4. #4
    kouxx's Avatar
    kouxx is offline Junior Member
    Join Date
    Aug 2008
    Posts
    160
    Reputation
    13
    Thanks
    14
    Thanked 37 Times in 26 Posts

    Default Re: Url harvesting problem

    drop me a pm... if you want

    i have a tool for you..

  5. #5
    justone's Avatar
    justone is offline Supreme Member
    Join Date
    Oct 2008
    Location
    Europe
    Posts
    1,496
    Reputation
    48
    Thanks
    116
    Thanked 984 Times in 259 Posts

    Default Re: Url harvesting problem

    also it is important to know that the number of hits google shows is usually WAY wrong.
    If google says it knows a million websites about a topic it is very possible that you can not get out more than a few % of them and google does not really know much more.

    I don't know how they estimate the total number of sites but that algorithm is very inaccurate at least.
    Fresh, fast, reliable and stable private proxies SEO-proxies.com - HTTP, SOCKS, VPN, API

  6. #6
    deef's Avatar
    deef is offline Junior Member
    Join Date
    Dec 2008
    Posts
    101
    Reputation
    9
    Thanks
    13
    Thanked 17 Times in 12 Posts

    Default Re: Url harvesting problem

    I have xrumer and hrefer.. could run for you a hrefer search.

  7. #7
    genie1's Avatar
    genie1 is offline Junior Member
    Join Date
    May 2008
    Posts
    151
    Reputation
    14
    Thanks
    22
    Thanked 52 Times in 27 Posts

    Default Re: Url harvesting problem

    I did some reading on this a few months ago because I ran into the same problem. It ''seems'' and I might be wrong, that its part of google's design not to go past 1000 results. They claim something like ''if you can't find it in the first 1000 results, your search isn't focused enough'' lol

    ▲ ▲

  8. #8
    justone's Avatar
    justone is offline Supreme Member
    Join Date
    Oct 2008
    Location
    Europe
    Posts
    1,496
    Reputation
    48
    Thanks
    116
    Thanked 984 Times in 259 Posts

    Default Re: Url harvesting problem

    and don't forget: if you hammer google too much you get soft banned which requires a captcha to continue.
    If you continue to hammer google they temp ban your ip.
    If you continue to use ips in the same subnet the same process happens.
    if you keep hammering they temp ban the whole subnet.
    After some hours to days the ban is lifted, no idea what happens if you keep scraping google, I read about permanent bans in various mailing lists.
    Fresh, fast, reliable and stable private proxies SEO-proxies.com - HTTP, SOCKS, VPN, API

Dot Gov Backlinks Sale


Smarter Submit

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
  SEnukeX SEO Software
Proudly Powered by Hostwinds.com Web Hosting Click Here For Exclusive BHW Discounts!

Cheap Web Hosting


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76