1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

GScraper Doubt

Discussion in 'Black Hat SEO Tools' started by warner410, Apr 21, 2013.

  1. warner410

    warner410 Regular Member

    Joined:
    Jul 28, 2012
    Messages:
    376
    Likes Received:
    172
    If scraping session is stopped and restarted, GScraper scrapes all keywords and footprints again?
     
  2. *Hawke*

    *Hawke* Junior Member Premium Member

    Joined:
    Apr 9, 2013
    Messages:
    126
    Likes Received:
    81
    Home Page:
    If you select "remove used keywords at scrape finished", when your stop scrape, GScraper can delete the used keywords and then you can continue scrape.
    And when you restart the soft, GScraper can record the keywords and footprints auto.

    add, with the pic of setting:
    123.jpg
     
    • Thanks Thanks x 1
  3. OC2000

    OC2000 Newbie

    Joined:
    Sep 25, 2013
    Messages:
    10
    Likes Received:
    1
    On topic with GScraper, after a scraping has finished and youre left with 50 -100, 1 million url txt files, is there a quick way to remove the duplicates? or do you need to load each one manually (like I have been doing) into GScraper and remove them 1 at a time?

    Thanks