1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

"A Search Engine for Developers, Marketers, Web Designers, and Hackers"

Discussion in 'BlackHat Lounge' started by phracktl, Jul 25, 2013.

  1. phracktl

    phracktl Regular Member

    Joined:
    Sep 2, 2012
    Messages:
    218
    Likes Received:
    152
    This new search engine might be of interest to some here:

    http://nerdydata.com/

    We have created a new type of search engine that searches on the full source code of webpages, not just the on-page text. It's called NerdyData (nerdydata.com) and we're launching today!

    Our search engine is different from search engines you've used before. Traditional search engines are geared towards providing answers, whereas our goal is to give you the best list of results for a query. Our crawler has visited over 140 million homepages and collected terabytes of HTML, Javascript, and CSS code. We've also designed several search interfaces that allow anybody to query against the source code of webpages, or download a list of sites containing a specific term.

    We even offer a search interface specifically for SEO's and marketers that allow you to search within specific HTML tags like meta descriptions and meta keywords.


    Basically, they've crawled >100 million sites to extract client side html/js/css which can be searched

    As they say, this could be useful for competitor research: backlinks, meta tags, finding all sites associated with an Adsense account

    {I have no connection to the site - just saw it on HN}
     
    • Thanks Thanks x 1
  2. Conor

    Conor Jr. VIP Jr. VIP

    Joined:
    Nov 7, 2012
    Messages:
    3,373
    Likes Received:
    5,439
    Gender:
    Male
    Location:
    South Africa
    Home Page: