1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Which scraping tool to use which can scrape based on conditional HTML code?

Discussion in 'Black Hat SEO Tools' started by smallbusinessguy, Sep 24, 2014.

  1. smallbusinessguy

    smallbusinessguy Registered Member

    Joined:
    Dec 20, 2012
    Messages:
    99
    Likes Received:
    14
    I need to scrape website based on the code they have. For example, scrape all websites which has google analytics. Is something like this possible with scrapers available in the market?

    A hosted version of something I want to achieve is --> http://trendspro.builtwith.com/market-analysis (it's too costly though)
     
  2. allaboutdomains

    allaboutdomains Junior Member

    Joined:
    Mar 3, 2014
    Messages:
    135
    Likes Received:
    29
    That's a tough one as you need to go to each site and see if it has google analytics on it. I cannot think of anyway to go directly to all sites with Google analytics.
     
  3. smallbusinessguy

    smallbusinessguy Registered Member

    Joined:
    Dec 20, 2012
    Messages:
    99
    Likes Received:
    14
    Guess that's why the builtwith guys charge so much :(
     
  4. balkhat

    balkhat Registered Member

    Joined:
    Sep 30, 2012
    Messages:
    77
    Likes Received:
    14
    What about something like NerdyData.com?
    "The search engine for source code"

    It doesn't appear to return very many results, but could be useful.

    Also, ScreamingFrog allows you to search by HTML code, but it is only within a single site as far as I am aware. Maybe you could upload a bulk list of urls into ScreamingFrog? idk for sure, might want to reach out to them or read their support to see if it's possible.