1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Xsubmitter - awesome spider - i am no longer scraping

Discussion in 'Black Hat SEO Tools' started by ScrapeboxWorker, May 8, 2014.

  1. ScrapeboxWorker

    ScrapeboxWorker Regular Member

    Joined:
    Jul 23, 2012
    Messages:
    465
    Likes Received:
    266
    Home Page:
    I just recently found the software, tool have more options, like posting, scraping from search engines etc. but what i am using it for is SPIDER.
    Basically you feed the software with "seeds", "navigation rules" and "link patterns".

    "Seeds" - starting linklist where Xsubmitter will start.
    "Seeds Change" - list of seeds to change after "X k" of collected links (or domains).
    "Navigation Rules" - links that xsubmitter will follow, on this guestbook that will be "act=show&page=" but that can be anything you can imagine.
    "Link Patterns" - every link with pattern that will be saved to our file. Let's say we want xpressengine, that will be document_srl


    Why i love it? Because of out of the box possibilities. And once i setup proper spider it will run for weeks giving me what i need, without proxies.
    Software have free trial version, but you can scrape only 10k links with trial. I found discount code for $10: BF0763AA

    Some results after importing 10k of scraped links into GSA:

    [​IMG]


    How to use it?

    1. xScraper button

    [​IMG]


    2. There is main menu of the spider:

    [​IMG]


    3. "More Options"

    [​IMG]

    Pass Per Domain: how many links to follow (navigation rules) per domain.
    Thread Interval: pause between threads
    Valid Links To Change Seeds (k): after X k of collected links xsubmitter will change seeds.


    4. Navigation rules what links to follow.

    [​IMG]

    5. Link Patterns - what links to collect (software comes with 11k patterns built in).

    [​IMG]

    6. The best option is to take a seed list, and split it.

    [​IMG]


    7. Then folder "seeds" input 1 file:

    [​IMG]

    8. In folder seeds change rest of the files:

    [​IMG]


    Enjoy
     
    • Thanks Thanks x 3
  2. zeetee

    zeetee Regular Member

    Joined:
    Mar 28, 2011
    Messages:
    299
    Likes Received:
    137
    Occupation:
    Home Based Online Business
    Location:
    Men are from Mars
    what was that, is it a sales thread, information or sharing tool?
     
  3. youmakeme

    youmakeme Power Member

    Joined:
    Dec 3, 2013
    Messages:
    605
    Likes Received:
    316
    Seems like a sales thread to me. But does not matter as it seems like an interesting tool
     
  4. JasonS

    JasonS Jr. VIP Jr. VIP

    Joined:
    Sep 15, 2012
    Messages:
    2,989
    Likes Received:
    912
    Home Page:
    OP, whats the difference between this tool, gscraper and scrapebox? Because I believe both tools already have these features.
     
  5. ScrapeboxWorker

    ScrapeboxWorker Regular Member

    Joined:
    Jul 23, 2012
    Messages:
    465
    Likes Received:
    266
    Home Page:
    Yes this is a SALES THREAD. Jesus christ i am just sharing with you, this is not my tool, go back to your caves.
    No, scrapebox and gscraper dont have spiders like this one.
     
    • Thanks Thanks x 2
  6. JustUs

    JustUs Power Member

    Joined:
    May 6, 2012
    Messages:
    609
    Likes Received:
    451
    I read the sales thread. It read like it was Chinese. I looked up the domain, it was Chinese. I think the only thing that was missing from the 60's jargon was the word "Groovy." Downloaded the trial. Seems like the authors would like to charge a monthly fee although they also have a lifetime license. Looked at the folder structure and it is almost identical to Xrumer. I am sure the operation is different. The description above makes it seem like it is a variation of WebSphinx, an older Java based crawler.
     
    • Thanks Thanks x 1
  7. asap1

    asap1 Jr. VIP Jr. VIP

    Joined:
    Mar 25, 2013
    Messages:
    4,432
    Likes Received:
    2,838
    Occupation:
    Quality Control PBN
    Home Page:
    So its a scraper but its uses a "Spider" and not proxies?
     
  8. BenPaolo

    BenPaolo Junior Member

    Joined:
    Apr 21, 2010
    Messages:
    172
    Likes Received:
    34
    This is exactly what I was looking for! Scraper + Spider + Automatic Identify & Sort In! My GSA SER would hate me for this. Now my problem is to how exactly to start it since it keeps on crashing damnit.

    Just read the manual. It's 30$ a month and supports 2 types of find links. The normal scraping (they provide proxy service with the monthly payment) and a spider mode which follows every anchor link it finds to find more target, basically how google finds the internet.
     
  9. arpitagarwal82

    arpitagarwal82 Power Member

    Joined:
    Feb 20, 2008
    Messages:
    709
    Likes Received:
    456
    Location:
    Localhost
    I had talked to the developer of Xsubmitter on skype couple of days back. He seems to be a very helpful guy.

    I am still playing with this tool and trying to figure out all the features it has. Till now it seems that this is very powerful tool. The only downside is that it was originally developed in chinese and hence there are very less help manuals or tutorials available in english.


    And for everyone else who are calling this a sales thread: Stop trolling OP. He is trying to help.
    Thanks OP for posting this guide.
     
  10. BenPaolo

    BenPaolo Junior Member

    Joined:
    Apr 21, 2010
    Messages:
    172
    Likes Received:
    34
    Have you tried adding all the footprints of GSA SER for the spider, scraper and categorizer?
    I just started playing with, could you enlighten me on how the dual mode works? It scrapes google first? Then makes those scraped list as the seed list for the spider? Or are they independent from each other and just run at the same time?
     
  11. arpitagarwal82

    arpitagarwal82 Power Member

    Joined:
    Feb 20, 2008
    Messages:
    709
    Likes Received:
    456
    Location:
    Localhost
    Dual mode?
    There are two type of scrapers in xsubmitter. SE Scraperand XScraper.
    SE Scraper scrapes list through search queries.
    Xscraper uses spiders.

    Cannot find where the dual mode is.
     
  12. BenPaolo

    BenPaolo Junior Member

    Joined:
    Apr 21, 2010
    Messages:
    172
    Likes Received:
    34
    Turns out I answered my own question. It was also mentioned in their manual: http://www.xsubmitterlabs.com/Manual.htm. Must be an upcoming feature.
     
    • Thanks Thanks x 1
  13. ScrapeboxWorker

    ScrapeboxWorker Regular Member

    Joined:
    Jul 23, 2012
    Messages:
    465
    Likes Received:
    266
    Home Page:
    It's spider like google spider, it follows links on domains and extracts what you want, all based on patterns like inurl:
     
  14. Marc_L

    Marc_L Regular Member

    Joined:
    Jun 11, 2012
    Messages:
    264
    Likes Received:
    59
    Did you ever get it to run? I can't and I've tried this on my home PC and at least 5 servers.

    edit: developer got it running, not sure how but it had something to do with .net framework being installed incorrectly.
     
    Last edited: May 19, 2014
  15. Cecil Dee

    Cecil Dee Registered Member

    Joined:
    Jan 30, 2013
    Messages:
    75
    Likes Received:
    9
    I'm wondering, how does the spidering done by the xscraper compare with gscraper scraping capabilities in terms of potential posting targets?
     
  16. Xebec

    Xebec Newbie

    Joined:
    Sep 17, 2012
    Messages:
    27
    Likes Received:
    5
    Any further experiences with this software to share? It sounds interesting and I really like the idea of not having to pay for a proxy service, but it still seems new and I'd like to hear a lot more experiences before jumping in.

    Still not clear why one would get this over GScraper/Scrapebox/GSA SER.
     
  17. ss_aussie

    ss_aussie Newbie

    Joined:
    Mar 31, 2013
    Messages:
    5
    Likes Received:
    4
    Looks very interesting especially including spider and dual mode, is this faster for scraping targets than the other tools (Scrapebox, Gscraper etc.)?

    Anyone care to share their experience with this?
     
  18. MariosElGreco

    MariosElGreco Regular Member

    Joined:
    May 31, 2014
    Messages:
    207
    Likes Received:
    7
    Gender:
    Male
    Occupation:
    http://eas-seo.com
    Location:
    Greece
    Home Page:
    Any new reviews to share ??
    i am willing to buy 1month to see by myself , but .. if anyone wants to share anything i'm here ..
     
  19. MonteCarlos

    MonteCarlos Regular Member

    Joined:
    Aug 1, 2015
    Messages:
    254
    Likes Received:
    334
    Gender:
    Male
    Occupation:
    Wannabe Money-Maker
    Location:
    Lost in CyberSpace
    Why the hell did you bumped a two years old thread? I bet that you are from these who voted the left political side in Greece, making us a joke for the whole world, aren't you? A$$hole...
     
  20. yorktownfashion

    yorktownfashion Regular Member

    Joined:
    Aug 20, 2012
    Messages:
    352
    Likes Received:
    13
    But why not let people try to use it.