1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Help Needed: Scraping WhoIs Email Data Programatically With Php

Discussion in 'Black Hat SEO Tools' started by skywalker55, Jan 10, 2012.

  1. skywalker55

    skywalker55 Junior Member

    Joined:
    Jan 29, 2010
    Messages:
    123
    Likes Received:
    109
    Occupation:
    Web App Development
    Location:
    London
    Hi everyone....I could really do with some help...

    I have built an app for a client of mine in php which is scraping an api to build a large database. It currently has over 2 million domain records.

    Some background to the app....its using cURL, its multi threaded and is running with 50 private proxies.

    He now wants a new feature that will get the email contact details from whois and add it to the database.

    I have been playing around with scrapebox's whois addon and that works....but problem is that its not done within my php application so although it works as a hack....its not an ongoing solution as the main app is adding new domains all the time.

    I want to write some php that will run on a cron job to query whois rather than using scrapebox.

    My problem is that I cannot find how to do this. To be honest I dont know much about whois...I cant even work out a single url to scrape the data from....

    On certain whois searches I found the email info I need but it appears to be storing the information on the page as an image ???

    Any information or help towards a solution would be really appreciates...
     
  2. infTee

    infTee Junior Member

    Joined:
    Mar 2, 2010
    Messages:
    101
    Likes Received:
    97
    Location:
    Ireland
    I haven't tried this out myself but have you seen this on sourceforge?
    Code:
    http://sourceforge.net/projects/phpwhois/
    Last Update: 2011-07-09 so it should be in working order.
     
  3. mistras1980

    mistras1980 Newbie

    Joined:
    Jun 25, 2011
    Messages:
    10
    Likes Received:
    0
    hi there ,

    if you have experience in scrapers / con jobs / ubot-zennoposter
    maybe besides the client you have you can get one more.

    I m interesting in scraping some real estate offers and posting them
    to a number of real estate portals.

    for someone with experience in scraping/ubot/zennoposter
    its doable (competitors are already doing it).

    if interested pls pm me.
    thanks
     
  4. skywalker55

    skywalker55 Junior Member

    Joined:
    Jan 29, 2010
    Messages:
    123
    Likes Received:
    109
    Occupation:
    Web App Development
    Location:
    London
    Thanks for that I have downloaded the files and will give it a try....
     
  5. mistras1980

    mistras1980 Newbie

    Joined:
    Jun 25, 2011
    Messages:
    10
    Likes Received:
    0
    try zenno poster!
    it has a long learning curve but its the best