[WTB]Whois scraper

ritesh

Senior Member

Oct 26, 2009

1,103

456

• Jun 20, 2010

• #1

Need a reliable WHOIS scraper that will access whois and scrape website url, admin email and admin name, and db it.
Scraper will be driven by keyword, and will have a filter where I can enter in urls to skip or not scrape.
Need something robust that will scrape at LEAST 100k records a day.

 

A

ampie

Newbie

Apr 30, 2010

46

14

• Jun 20, 2010

• #2

Scrapebox has an addon for a whois scraper. I haven't used it, so I can't comment much specifically on it myself. Hope that points you in the right direction though.

 

U

unknwn

BANNED

Dec 19, 2009

151

61

• Jun 20, 2010

• #3

I have one here right now.

 

risefromdeath

BANNED

Jul 1, 2009

651

107

• Jun 20, 2010

• #4

i have created one before..let me know what features you need in detail and i will get it done for you right away.
Thanks

 

M

makingaccount97

Newbie

Apr 16, 2009

44

13

• Jun 21, 2010

• #5

hey can make it very fast in php

it would be damn faster then other one

sending you PM

 

U

unknwn

BANNED

Dec 19, 2009

151

61

• Jun 21, 2010

• #6

makingaccount97 said:

hey can make it very fast in php

it would be damn faster then other one

sending you PM

Click to expand...

1. php is not executed as asm but first need to be parsed and compiled on the fly.
2. No threadings support in php cgi only a simple version in php cli.

so no buddy it wont be damn faster then another language that has been build for these purposes.

 

tas26

Power Member

Apr 21, 2009

629

314

• Jun 21, 2010

• #7

Hey! guys can you please share here your scappers. I just need it to search for emails of given URLs. If you have it please share.

 

M

makingaccount97

Newbie

Apr 16, 2009

44

13

• Jun 22, 2010

• #8

unknwn said:

1. php is not executed as asm but first need to be parsed and compiled on the fly.
2. No threadings support in php cgi only a simple version in php cli.

so no buddy it wont be damn faster then another language that has been build for these purposes.

Click to expand...

hey do you know we can run it multiple ?

so it can be done as we want.. and those things macro will handle very well

it can open diff tabs and run it and can manage size of url file

anyway.. let me know if you want to see demo on TV

or

ignore it

Thanks

 

U

unknwn

BANNED

Dec 19, 2009

151

61

• Jun 22, 2010

• #9

makingaccount97 said:

hey do you know we can run it multiple ?

so it can be done as we want.. and those things macro will handle very well

it can open diff tabs and run it and can manage size of url file

anyway.. let me know if you want to see demo on TV

or

ignore it

Thanks

Click to expand...

like you wanna have 50 tabs open instead of pushing 1 button and not freezing your pc

 

SEO Authority

Senior Member

Apr 21, 2010

900

1,125

• Jun 22, 2010

• #10

I want one if anyone can sell to me for $10

 

M

Mauikid

Newbie

Jun 24, 2010

17

3

• Jul 25, 2010

• #11

If anyone can either build me a whois scraper or recommend something solid, pm me as I am looking to generate biz opp leads.

Thanks!

 

A

azibob

Newbie

Mar 13, 2009

14

8

• Jul 26, 2010

• #12

100k? is there any limit in whois requests?

 

Z

zelma143

Power Member

Jun 25, 2010

573

37

• Jul 27, 2010

• #13

azibob said:

100k? is there any limit in whois requests?

Click to expand...

it would be unlimited.. if you use proxy or diff ips

 

B

bryanon

Supreme Member

Oct 16, 2009

1,343

1,520

• Jul 28, 2010

• #14

I need something similar.

Need to feed (only) 100-200 domain names at a time and the response (either plain text, CSV or any other easily processable format) has to contain general information, such as domain name, owner's name, owner's email etc.

Processing time isn't important as volumes aren't high.

If someone's up for this gig, let me know.

 

D

Dayum

BANNED

Mar 22, 2010

271

91

• Jul 28, 2010

• #15

Just buy scrapebox, I dont know how fast it is I haven't tested it, but I know it can scrape email, url, that shit. And with free proxy harvester built in you'll have proxies to use with it.