1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Proffessional scraper ??

Discussion in 'Black Hat SEO' started by MariosElGreco, Feb 28, 2016.

  1. MariosElGreco

    MariosElGreco Regular Member

    Joined:
    May 31, 2014
    Messages:
    261
    Likes Received:
    8
    Gender:
    Male
    Occupation:
    http://eas-seo.com
    Location:
    Greece
    Home Page:
    I want to buy scraper like seo frog with :
    1. threads up to 500 . 1000 will much prefered.
    2. to scrap only one site.. every link.
    like seo frog , but it has only 200threads max and i can scrape with more than 1000.
    Also if it can saving the caches on hdd its prefered becouse with 64gb ram its not possible to scrape big big sites.. seo frog save caches of the crawled pages on the ram .. too bad for a disent scraper.
     
  2. redarrow

    redarrow Elite Member

    Joined:
    Apr 1, 2013
    Messages:
    4,302
    Likes Received:
    983
    Last edited: Feb 28, 2016
  3. MariosElGreco

    MariosElGreco Regular Member

    Joined:
    May 31, 2014
    Messages:
    261
    Likes Received:
    8
    Gender:
    Male
    Occupation:
    http://eas-seo.com
    Location:
    Greece
    Home Page:
    can scrape only one site? like spider ? i know that is one of the best crawlers like hrefer and gscraper but both of them they scrape only internet , they can't act like a spiders thought .
    scrapebox has this option ? didn't knew that .
    i want to beilive it can scrape up to 1000. and i am sure it will have rotate proxies .. true ?
     
  4. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,993
    Gender:
    Male
    Home Page:
    It has a grab links by crawling a site function built to crawl a site up to 10 levels deep. It can use 500 threads. Its 64bit so it could use all 64GB of RAM you have if need be, but it does hold this in memory. although its highly memory efficient. It may actually dump it to disk at certain intervals, Im not sure, I can find out and post back, Ill ask support.

    But it does auto save to disk when done.
     
  5. MariosElGreco

    MariosElGreco Regular Member

    Joined:
    May 31, 2014
    Messages:
    261
    Likes Received:
    8
    Gender:
    Male
    Occupation:
    http://eas-seo.com
    Location:
    Greece
    Home Page:
    thanks ., ill check it out . i ask from the owner of the software 1day trial before buy it .. will see ..
     
  6. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,993
    Gender:
    Male
    Home Page:
    It saves the results to disk in the grabbed links folder (in your scrapebox folder) in real time with a date/time stamp. That way nothing is lost if there is a crash.
     
  7. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,726
    Likes Received:
    1,993
    Gender:
    Male
    Home Page:
    I can tell you there are no trials. But its $67 so its not terribly high and further its a lifetime license and it has a mountain load of tools which Im sure you would also find handy in time.