Help Needed: Scraping WhoIs Email Data Programatically With Php

skywalker55

Junior Member
Joined
Jan 29, 2010
Messages
123
Reaction score
110
Hi everyone....I could really do with some help...

I have built an app for a client of mine in php which is scraping an api to build a large database. It currently has over 2 million domain records.

Some background to the app....its using cURL, its multi threaded and is running with 50 private proxies.

He now wants a new feature that will get the email contact details from whois and add it to the database.

I have been playing around with scrapebox's whois addon and that works....but problem is that its not done within my php application so although it works as a hack....its not an ongoing solution as the main app is adding new domains all the time.

I want to write some php that will run on a cron job to query whois rather than using scrapebox.

My problem is that I cannot find how to do this. To be honest I dont know much about whois...I cant even work out a single url to scrape the data from....

On certain whois searches I found the email info I need but it appears to be storing the information on the page as an image ???

Any information or help towards a solution would be really appreciates...
 
I haven't tried this out myself but have you seen this on sourceforge?
Code:
http://sourceforge.net/projects/phpwhois/
Last Update: 2011-07-09 so it should be in working order.
 
hi there ,

if you have experience in scrapers / con jobs / ubot-zennoposter
maybe besides the client you have you can get one more.

I m interesting in scraping some real estate offers and posting them
to a number of real estate portals.

for someone with experience in scraping/ubot/zennoposter
its doable (competitors are already doing it).

if interested pls pm me.
thanks
 
I haven't tried this out myself but have you seen this on sourceforge?
Code:
http://sourceforge.net/projects/phpwhois/
Last Update: 2011-07-09 so it should be in working order.

Thanks for that I have downloaded the files and will give it a try....
 
Back
Top