Sending millions of get request
- Thread starter nihalar
- Start date
- Mar 30, 2010
- 1,279
- 415
That's why there are lots of residential proxies online！
Use it never got blocked...
Use it never got blocked...
BrazilianBusinessman
Power Member
- Mar 18, 2019
- 693
- 365
If you send 350k on 20 devices its still 7 Million or 70 x 100k
Find a number you doesnt get blocked and play with It
Any recommendation for cheap proxy pool services providing above 5k proxies which can be used concurrently?
Couldn’t find any which can do this.
From my limited testing.. 5k probably. The main problem is I need to do this in an 1hr, so the amount of request that each device need to send in 1sec is over quite high.
Celil Yaman
Junior Member
- Feb 24, 2019
- 108
- 20
hmmmm btw
bagle
Registered Member
- Nov 7, 2019
- 55
- 5
You will get blocked when you fire 5K requests per 1hour, is this correct?
Ys its correct
- Nov 12, 2012
- 1,565
- 893
That sounds like a DDOS - maybe they have setup a protection in place for their API for these kind of actions.
- Jul 26, 2015
- 2,625
- 711
First to know, what's the device fingerprinting,
such as User-agent, Canvas... (IP address is important to factor also).
To Send requests without got block...
check robots.txt at first,
Then check offer API or not,
To avoid device fingerprinting issue, you can use Headless browsers, such as Selenium and Puppeteer
I write a post about,
I think you can learn it, though I do not know your purpose to sent requests, I think many are similar to scraper.
such as User-agent, Canvas... (IP address is important to factor also).
To Send requests without got block...
check robots.txt at first,
Then check offer API or not,
To avoid device fingerprinting issue, you can use Headless browsers, such as Selenium and Puppeteer
I write a post about,
I think you can learn it, though I do not know your purpose to sent requests, I think many are similar to scraper.
Thx.
I was wondering if i could do this in aws lambda without any proxies?
Any experience with it?
- Jul 26, 2015
- 2,625
- 711
Sorry, no experience, I think no matter use what, too many requests from one IP/server are impossible...
Andy17
Newbie
- Jan 9, 2017
- 42
- 12
checkout here: https://www.blackhatworld.com/forums/proxies-for-sale.112/ and here: https://www.blackhatworld.com/forums/proxy-lists.103/
Personanny I use this guy: https://www.blackhatworld.com/seo/storm-proxies-70-000-premium-reverse-rotating-proxies-starting-from-11-90.819976/ but the most requests i'm making per day are around 0.1-0.5M. not a 7M/h.
masterofall
Newbie
- Dec 23, 2019
- 16
- 2
That's about 2k requests / second. You will need multiple machines or just a service to do it for you.
Oh -- and of course you need proxies to mask your addresses. I'd just pay to use a service it will be as much to do it yourself.
Oh -- and of course you need proxies to mask your addresses. I'd just pay to use a service it will be as much to do it yourself.
Last edited by a moderator:
kodmanyagha
Newbie
- Oct 11, 2019
- 26
- 5
What will you do with this? Will you use this for hâcking or ddos?
h3y4w
Registered Member
- Feb 11, 2013
- 56
- 11
Lol I was thinking the same thing.