1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[WTB]Whois scraper

Discussion in 'Hire a Freelancer' started by ritesh, Jun 20, 2010.

  1. ritesh

    ritesh Senior Member

    Joined:
    Oct 26, 2009
    Messages:
    1,046
    Likes Received:
    443
    Need a reliable WHOIS scraper that will access whois and scrape website url, admin email and admin name, and db it.
    Scraper will be driven by keyword, and will have a filter where I can enter in urls to skip or not scrape.
    Need something robust that will scrape at LEAST 100k records a day.
     
  2. ampie

    ampie Newbie

    Joined:
    Apr 30, 2010
    Messages:
    46
    Likes Received:
    14
    Scrapebox has an addon for a whois scraper. I haven't used it, so I can't comment much specifically on it myself. Hope that points you in the right direction though.
     
  3. unknwn

    unknwn BANNED BANNED

    Joined:
    Dec 19, 2009
    Messages:
    151
    Likes Received:
    59
    I have one here right now.
     
  4. risefromdeath

    risefromdeath Power Member

    Joined:
    Jul 1, 2009
    Messages:
    650
    Likes Received:
    107
    i have created one before..let me know what features you need in detail and i will get it done for you right away.
    Thanks
     
  5. makingaccount97

    makingaccount97 Newbie

    Joined:
    Apr 16, 2009
    Messages:
    46
    Likes Received:
    13
    hey can make it very fast in php

    it would be damn faster then other one

    sending you PM
     
  6. unknwn

    unknwn BANNED BANNED

    Joined:
    Dec 19, 2009
    Messages:
    151
    Likes Received:
    59
    1. php is not executed as asm but first need to be parsed and compiled on the fly.
    2. No threadings support in php cgi only a simple version in php cli.

    so no buddy it wont be damn faster then another language that has been build for these purposes.
     
  7. tas26

    tas26 Power Member

    Joined:
    Apr 21, 2009
    Messages:
    548
    Likes Received:
    274
    Occupation:
    student
    Location:
    BHW
    Hey! guys can you please share here your scappers. I just need it to search for emails of given URLs. If you have it please share.
     
  8. makingaccount97

    makingaccount97 Newbie

    Joined:
    Apr 16, 2009
    Messages:
    46
    Likes Received:
    13

    hey do you know we can run it multiple ?

    so it can be done as we want.. and those things macro will handle very well

    it can open diff tabs and run it and can manage size of url file

    anyway.. let me know if you want to see demo on TV

    or

    ignore it

    Thanks
     
  9. unknwn

    unknwn BANNED BANNED

    Joined:
    Dec 19, 2009
    Messages:
    151
    Likes Received:
    59
    like you wanna have 50 tabs open instead of pushing 1 button and not freezing your pc :)
     
  10. SEO Authority

    SEO Authority Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 21, 2010
    Messages:
    800
    Likes Received:
    1,071
    I want one if anyone can sell to me for $10
     
  11. Mauikid

    Mauikid Newbie

    Joined:
    Jun 24, 2010
    Messages:
    17
    Likes Received:
    2
    If anyone can either build me a whois scraper or recommend something solid, pm me as I am looking to generate biz opp leads.

    Thanks!
     
  12. azibob

    azibob Newbie

    Joined:
    Mar 13, 2009
    Messages:
    14
    Likes Received:
    8
    100k? is there any limit in whois requests?
     
  13. zelma143

    zelma143 Power Member

    Joined:
    Jun 25, 2010
    Messages:
    571
    Likes Received:
    37
    Occupation:
    PHP programmer,Bot maker,iMacro script maker

    it would be unlimited.. if you use proxy or diff ips
     
  14. bryanon

    bryanon Executive VIP Premium Member

    Joined:
    Oct 16, 2009
    Messages:
    1,395
    Likes Received:
    1,479
    I need something similar.

    Need to feed (only) 100-200 domain names at a time and the response (either plain text, CSV or any other easily processable format) has to contain general information, such as domain name, owner's name, owner's email etc.

    Processing time isn't important as volumes aren't high.

    If someone's up for this gig, let me know.
     
  15. Dayum

    Dayum BANNED BANNED

    Joined:
    Mar 22, 2010
    Messages:
    271
    Likes Received:
    90
    Just buy scrapebox, I dont know how fast it is I haven't tested it, but I know it can scrape email, url, that shit. And with free proxy harvester built in you'll have proxies to use with it.