[URGENT] Create This Software.

CustomBotShop · Aug 25, 2015

Parlez said:
I was basing this on the task as a whole (list size, not thread number, which is grossly exaggerated anyway).

Scraping over 500GB of data (assuming average page size is 5kb) for specific anchor text along with form filling and captchas is extremely CPU intensive and working with multiple lists of 10M records each requires a significant amount of RAM.

lancis · Aug 25, 2015

YourMoneyButton said:
You would need 1000 threads to open 1000 simultaneous socket connections, you can have one socket connection running 1000 simultaneous threads but not one thread making 1000 concurrent socket connections.

He's still talking about downloading over 500GB of data at "blazing speeds"

This is where you're mistaken - you need only 1 thread to open 1000 concurrent socket connections.

Have a look at Nginx if you dont believe me.
He will need a good connection for the concurrent downloads, but thats a totally different problem.

Pranteek · Aug 26, 2015

Sent you a PM. Pls check ur inbox.

kenidy · Aug 26, 2015

is there some software to help you realize what you have thought? if so, i have to say the computer is so powerful, besides, yesterday, i head of someone said that whitehatbox programmer can program bot for anyone if you can think out, i do not know whether it is true, maybe you can try

DanTe_0101 · Aug 26, 2015

lol @30isoverpriced

TOBBOT · Aug 27, 2015

hi,
probably I can do this job, but I need more data & examples.

For task #1 I will use pure Java.
For task #2 I will use TOBBOT (my own software to create bots).

You should know that 1000+ threads can work slowly by the reason of slow DNS server. For example Google DNS server allow you to resolve only 100 domains per second.

100M / 100 = 1M seconds = 11,5 days

[URGENT] Create This Software.

CustomBotShop

Senior Member

lancis

Elite Member

Pranteek

Junior Member

kenidy

Newbie

DanTe_0101

Supreme Member

TOBBOT

Newbie

Main Menu

Marketplace

Making Money

BlackHat World