1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

X-rumer - need a little help

Discussion in 'Black Hat SEO' started by morgi666, May 17, 2010.

  1. morgi666

    morgi666 Registered Member

    Joined:
    Jan 14, 2010
    Messages:
    69
    Likes Received:
    17
    I've got a small list of keywords (around 3k). I've set hrefer to scrape forums. It took ~2 days to get 300k URLs. I've tried to get more keywords and speed up a process by uploading engine.php (for proxy harvester) to my server (host9ator), but hrefer didn't like it (couldn't use it, list.txt 0777 and engine.php 0755 - no errors on my side) so I moved back to default botmasternet[.]com/proxy/http/engine.php. It scrapes around 200-250 proxies. Now I try to run hrefer with any keywords and it just not finding URLs (something like 90 URLs after 24h). I've tried to use SOCKS. it's scraping proxies fast, adding 500 easy, but scraping results are the same...

    I thought it's maybe my keywords or something so I uses same list I had on the beginning - no URLs ;|

    Any idea what can be a problem?
    It's running on VPS: Windows Server 2003 R2 x64, Intel Core Quad Q9300 (2.50 GHz) with 8GB of RAM on quite good 8Mb broadband.

    Any ideas/help appreciated...
     
  2. designsonline

    designsonline Power Member

    Joined:
    Jan 22, 2009
    Messages:
    651
    Likes Received:
    145
    Location:
    UK
    If you have Scrapebox try scraping with that, Google have made changes, and Im not sure if HReffer has updated to allow for them yet. Scrapebox has, and you can scrape 300k forums in a few minutes with scrapebox.

    Scrape with scrapebox, and post with Xrumer
     
    • Thanks Thanks x 1
  3. morgi666

    morgi666 Registered Member

    Joined:
    Jan 14, 2010
    Messages:
    69
    Likes Received:
    17
    I thought that to, so I've run hrefer to scrape from bing - better but still very small amounts of URLs.
    But yeah, I will run scrapebox for now. Thanks for nice tip!
     
  4. cdc515

    cdc515 Power Member

    Joined:
    Nov 23, 2009
    Messages:
    602
    Likes Received:
    92
    • Thanks Thanks x 1
  5. morgi666

    morgi666 Registered Member

    Joined:
    Jan 14, 2010
    Messages:
    69
    Likes Received:
    17
    Thanks cdc515! Simple change in .ini file nad works like a charm again ;]