1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Few Xrumer, Hrefer and proxies questions...

Discussion in 'Black Hat SEO Tools' started by m_zec, May 7, 2011.

  1. m_zec

    m_zec Jr. VIP Jr. VIP Premium Member

    Joined:
    May 3, 2010
    Messages:
    331
    Likes Received:
    440
    So i got my hands on Xrumer few days ago and I am trying to learn how to use it..

    I am having trouble with hrefer.. I cant scrape anything..

    First I scraped proxies from one forum put them in scrapebox and I got 200 working ones... I put working proxies in xproxy.txt..

    Then I scraped some keywords with scrapebox and put them in hrefer/words folder..

    Then I started hrefer and uncheck SOCKS in proxy list tab. Also I selected my words.txt file and hit start parsing..

    And nothing I happening.. All is running fine but at the end I dont have any links...

    Are proxies problem?
     
  2. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Have you checked your sieve filter? With the default install of hrefer, the sieve filter will contain a bunch of URL strings, i.e. it's not empty. This means that when you harvest, if the URL does not contain one of the strings as listed in the sieve filter, it will be discarded and nothing will be registered. This is the most common problem I encounter with newbies to hrefer. Disable the sieve filter and try again.

    If this is not the problem try harvesting without proxies for a bit. Sure your IP will be banned soon but don't go that far - just test to see if anything is coming.

    Check your footprint(s) to see if they are concise and do not contain special operators which G is becoming increasingly strict on. Let me know if it still doesn't work.
     
    • Thanks Thanks x 1
  3. nbsweb

    nbsweb Junior Member

    Joined:
    Jan 5, 2009
    Messages:
    169
    Likes Received:
    74
    • Thanks Thanks x 1
  4. m_zec

    m_zec Jr. VIP Jr. VIP Premium Member

    Joined:
    May 3, 2010
    Messages:
    331
    Likes Received:
    440
    I own pre-installed xrumer on vps so I contacted support and they told me that hrefer is not working with google and that I need to change engines.ini file... Only problem is that I dont know where to find new engines.ini file...

    Great post.. thanks!
     
  5. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Wow, since when is hrefer not working? Mine works fine with no modifications. So you're sure it's not to do with the sieve filter? This is strange and the best way to get this fixed is to contact botmaster.
     
  6. m_zec

    m_zec Jr. VIP Jr. VIP Premium Member

    Joined:
    May 3, 2010
    Messages:
    331
    Likes Received:
    440
    It is 2.99.1 version if that makes any difference..
     
  7. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Yes it does make a difference. Why don't you upgrade to Hrefer 3.3 as everyone else is using? As I see it you can't actually download Hrefer 2.99.1 in the botmaster cpanel - it's very likely that some changes have been made by search engines which have been addressed in the latest version.
     
    • Thanks Thanks x 1
  8. darshan1994

    darshan1994 BANNED BANNED

    Joined:
    Oct 9, 2009
    Messages:
    654
    Likes Received:
    318
    Google data centers
    Code:
    4.233.163.83
    64.233.163.84
    64.233.163.100
    64.233.163.104
    64.233.163.115
    64.233.163.184
    64.233.163.189
    64.233.169.19
    64.233.169.44
    64.233.169.81
    64.233.169.83
    64.233.169.84
    64.233.169.99
    64.233.169.104
    64.233.169.115
    64.233.169.184
    64.233.179.44
    64.233.179.81
    64.233.179.83
    64.233.179.84
    64.233.179.91
    64.233.179.93
    64.233.179.100
    64.233.179.104
    64.233.179.115
    64.233.179.184
    64.233.183.17
    64.233.183.18
    64.233.183.19
    64.233.183.44
    64.233.183.81
    64.233.183.83
    64.233.183.84
    64.233.183.91
    64.233.183.93
    64.233.183.99
    64.233.183.103
    64.233.183.104
    64.233.183.115
    64.233.183.147
    64.233.183.184
    66.102.7.19
    66.102.7.44
    66.102.7.81
    66.102.7.83
    66.102.7.84
    66.102.7.98
    66.102.7.99
    66.102.7.100
    66.102.7.101
    66.102.7.104
    66.102.7.115
    66.102.7.133
    66.102.7.184
    66.102.11.100
    66.102.11.104
    66.249.89.19
    66.249.89.44
    66.249.89.81
    66.249.89.83
    66.249.89.84
    66.249.89.99
    66.249.89.104
    66.249.89.115
    66.249.89.133
    66.249.89.184
    72.14.203.99
    72.14.203.100
    72.14.203.101
    72.14.203.102
    72.14.203.104
    72.14.203.147
    72.14.203.184
    72.14.209.99
    72.14.209.101
    72.14.209.104
    209.85.225.99
    209.85.227.147
    209.85.229.104
    209.85.229.147
    74.125.113.104
    74.125.155.104
    74.125.155.147
    74.125.157.104
    74.125.157.99
    74.125.159.104
    74.125.159.147
    74.125.159.99
    74.125.39.147
    74.125.43.104
    74.125.47.99
    74.125.53.99
    74.125.65.147
    74.125.65.99
    74.125.67.147
    74.125.67.99
    74.125.77.104
    74.125.79.147
    74.125.87.99
    74.125.91.147
    74.125.91.99
    74.125.93.99
    Use Yahoo, your proxies will work much better and more result
     
    • Thanks Thanks x 1
    Last edited: May 8, 2011
  9. m_zec

    m_zec Jr. VIP Jr. VIP Premium Member

    Joined:
    May 3, 2010
    Messages:
    331
    Likes Received:
    440
    I cant upgrade because I own vps with pre installed software like xrumer... Only vps owner can install new software or upgrade it.. It is cheap and it have lots of limitations.. I should expect this sorts of problems for that much money.. lol... I will try to find out why hrefer is not upgraded to last version... Anyway thank you for help.. :)
     
  10. m_zec

    m_zec Jr. VIP Jr. VIP Premium Member

    Joined:
    May 3, 2010
    Messages:
    331
    Likes Received:
    440
    Tnx man!
     
  11. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    The problem with Yahoo is that they miss a lot of pages and Yahoo REALLY sucks with harvesting non-english pages. G really is the best for harvesting, except it is a bitch to get good proxies.

    Ask your VPS provider to upgrade to hrefer 3.3! It shouldn't be that difficult for them ffs!
     
    • Thanks Thanks x 1