1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Xrumer Hrefer Question

Discussion in 'Black Hat SEO' started by emilix123, Feb 9, 2011.

  1. emilix123

    emilix123 Junior Member

    Joined:
    Apr 14, 2010
    Messages:
    161
    Likes Received:
    2
    guys I would buy XRumer but I have some questions to ask
    ... a question about Hrefer: links that are unable to find unique domains or there may be duplicate domains?

    in a thread I read that i can find 500k link in 48h...
    is possible find 500k unique domains in 48 hours?

    Hrefer find only forums links or all possible links that can handle XRumer?

    thanks
     
  2. yayoyayo

    yayoyayo Junior Member

    Joined:
    Jul 15, 2008
    Messages:
    188
    Likes Received:
    224
    Hefer will save all links based on your filters.

    By default in hrefer such forum filter
    HTML:
    forum
    phorum
    topic
    bulletin
    thread
    modules.php
    yabb
    ultimatebb
    board
    phpbb
    act=st
    act=sf
    list.php
    posting
    profile.php
    act=reg
    post.php
    ubb
    exbb
    newbb
    ipb
    invision
    foro/
    /sutra
    lofiversion
    forumdisplay.php
    showthread.php
    newreply.php
    newthread.php
    yabb.pl
    posting.php
    viewtopic.php
    viewforum
    /community/
     
  3. emilix123

    emilix123 Junior Member

    Joined:
    Apr 14, 2010
    Messages:
    161
    Likes Received:
    2
    ok thanks so I can put all my footprints in the filter ?

    but the results are unique domains or duplicate?
     
  4. reinie

    reinie Elite Member

    Joined:
    Jan 16, 2009
    Messages:
    1,574
    Likes Received:
    1,040
    you can remove duplicate domains
     
  5. yayoyayo

    yayoyayo Junior Member

    Joined:
    Jul 15, 2008
    Messages:
    188
    Likes Received:
    224
    On the fly so hrefer will save only unique domains.
     
  6. contemptx

    contemptx Regular Member

    Joined:
    Jun 7, 2009
    Messages:
    253
    Likes Received:
    21
    Occupation:
    Internet Marketing
    Location:
    UK
    Home Page:
    Correct, you can set hrefer to save only unique domains.

    if you setup hrefer on a decent connection with a good amount of proxies (preferably socks) then you can scrape a decent list in no time.

    You can also use the tools within xrumer to post-process & remove duplicate domains from the linkslist.

    Alot of people also using the scraping feature in scrapebox as again with a decent proxy list and internet connection, this can yield a good amount of links within a short period of time.
     
  7. dzoniij

    dzoniij Regular Member

    Joined:
    May 24, 2009
    Messages:
    469
    Likes Received:
    111
    I harvested 1.5 million forum links within 24H and all unique domains but it depends lot form internet connection and server/computer I have 500mbit/s Internet and AMD hexacore computer traffic usage ~ 1TB/24H
    in hrefer options you can set that hrefer remove duplicate domains in harvesting process.