Need some help and tips for Gscraper and footprints

[jackl]

So I bought Gscraper a few days ago and took a proxy service, now i'm stuck with a few issues.
First of all i'm not sure what settings I should use for threads for example and timeout. I have it set at 500 threads and 60 seconds timeout right now but the scraping is pretty slow.
I feel like i'm wasting the power of the dedicated server e3-1230 16gb ram 1gbps since i'm barely using anything.
And I don't even know what happens when you add more timeout or threads, because there's no faq, there's no forums for gscraper, so i'm a bit confused.

Secondly I don't know what footprints to use. I don't mind paying a bit of a price for it, but I really have no clue where I should get them. I'm just using some I found here on the forums but they seem not to work too well.
I am planning to use these links in gsa ser, so I need some footprints for that.

Thanks, hopefully someone can help me out I would appreciate it.

 

[twilightofidols]

How many threads depends a lot on what your box can handle. Are you using a VPS or Dedi? I run GScraper at 1500 threads (MAX) on my Dedi. If you set the timeout at 15 you'll only scrape with the faster proxies but more proxies will fail, if you set it to Change and Retry it'll just keep going till it finds a fast proxy the scrape. I don't set my timeout as high as 60 seconds, but you're likely to stumble on more working proxies from their proxy server that way.

URLs per minute tends to vary based on a number of factors. Including your footprints, the machine you're running it on, and the quality of the proxy service.

All of the footprints you'll find on this forum work. The best footprints you'll find will be your own footprints. There are many tutorials on how to find footprints.

 

[jackl]

How many threads depends a lot on what your box can handle. Are you using a VPS or Dedi? I run GScraper at 1500 threads (MAX) on my Dedi. If you set the timeout at 15 you'll only scrape with the faster proxies but more proxies will fail, if you set it to Change and Retry it'll just keep going till it finds a fast proxy the scrape. I don't set my timeout as high as 60 seconds, but you're likely to stumble on more working proxies from their proxy server that way.

URLs per minute tends to vary based on a number of factors. Including your footprints, the machine you're running it on, and the quality of the proxy service.

All of the footprints you'll find on this forum work. The best footprints you'll find will be your own footprints. There are many tutorials on how to find footprints.

Dedicated server 16gb ram e3-1230 1gbps

I'm using public proxy's port scanned ones from a service here on bhw so I take you do too?

Are there any drawbacks from using higher threads, since my proxy provider told me not to use too many threads?

 

[jackl]

Bump!

After tweaking some settings i'm hitting 100k/min.

But i'm still wondering where I should get some more footprints+keywords.

 

[SerpEvil]

u need some good proxies.i can scrape 92k urls/min with good proxies.even with proxies scraped by no hands proxies i still get 30-50k/min on scraping.gscraper have a 15 k database keywords which might be enough if u have the right footprints

 

[jackl]

u need some good proxies.i can scrape 92k urls/min with good proxies.even with proxies scraped by no hands proxies i still get 30-50k/min on scraping.gscraper have a 15 k database keywords which might be enough if u have the right footprints

Yeah i'm hitting 100k/min now but I still need some more footprints for gsa mainly because my current footprints don't seem to be good enough.

 

[shadowjack]

Yeah i'm hitting 100k/min now but I still need some more footprints for gsa mainly because my current footprints don't seem to be good enough.

hi, how do you hit 100k/min ?