1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Need some help and tips for Gscraper and footprints

Discussion in 'Black Hat SEO' started by jackl, Jul 8, 2014.

  1. jackl

    jackl Regular Member

    Joined:
    Apr 20, 2014
    Messages:
    218
    Likes Received:
    39
    So I bought Gscraper a few days ago and took a proxy service, now i'm stuck with a few issues.
    First of all i'm not sure what settings I should use for threads for example and timeout. I have it set at 500 threads and 60 seconds timeout right now but the scraping is pretty slow.
    I feel like i'm wasting the power of the dedicated server e3-1230 16gb ram 1gbps since i'm barely using anything.
    And I don't even know what happens when you add more timeout or threads, because there's no faq, there's no forums for gscraper, so i'm a bit confused.

    Secondly I don't know what footprints to use. I don't mind paying a bit of a price for it, but I really have no clue where I should get them. I'm just using some I found here on the forums but they seem not to work too well.
    I am planning to use these links in gsa ser, so I need some footprints for that.

    Thanks, hopefully someone can help me out I would appreciate it.
     
  2. twilightofidols

    twilightofidols Power Member

    Joined:
    Nov 11, 2011
    Messages:
    675
    Likes Received:
    224
    How many threads depends a lot on what your box can handle. Are you using a VPS or Dedi? I run GScraper at 1500 threads (MAX) on my Dedi. If you set the timeout at 15 you'll only scrape with the faster proxies but more proxies will fail, if you set it to Change and Retry it'll just keep going till it finds a fast proxy the scrape. I don't set my timeout as high as 60 seconds, but you're likely to stumble on more working proxies from their proxy server that way.

    URLs per minute tends to vary based on a number of factors. Including your footprints, the machine you're running it on, and the quality of the proxy service.

    All of the footprints you'll find on this forum work. The best footprints you'll find will be your own footprints. There are many tutorials on how to find footprints.
     
    • Thanks Thanks x 1
  3. jackl

    jackl Regular Member

    Joined:
    Apr 20, 2014
    Messages:
    218
    Likes Received:
    39
    Dedicated server 16gb ram e3-1230 1gbps

    I'm using public proxy's port scanned ones from a service here on bhw so I take you do too?

    Are there any drawbacks from using higher threads, since my proxy provider told me not to use too many threads?
     
    Last edited: Jul 8, 2014
  4. jackl

    jackl Regular Member

    Joined:
    Apr 20, 2014
    Messages:
    218
    Likes Received:
    39
    Bump!

    After tweaking some settings i'm hitting 100k/min.

    But i'm still wondering where I should get some more footprints+keywords.
     
  5. SerpEvil

    SerpEvil Supreme Member

    Joined:
    Jan 1, 2012
    Messages:
    1,496
    Likes Received:
    448
    Gender:
    Male
    Occupation:
    WebMaster
    Location:
    Top 3 On Google
    u need some good proxies.i can scrape 92k urls/min with good proxies.even with proxies scraped by no hands proxies i still get 30-50k/min on scraping.gscraper have a 15 k database keywords which might be enough if u have the right footprints
     
  6. jackl

    jackl Regular Member

    Joined:
    Apr 20, 2014
    Messages:
    218
    Likes Received:
    39
    Yeah i'm hitting 100k/min now but I still need some more footprints for gsa mainly because my current footprints don't seem to be good enough.
     
  7. shadowjack

    shadowjack Registered Member

    Joined:
    Aug 31, 2013
    Messages:
    59
    Likes Received:
    8
    hi, how do you hit 100k/min ?