1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

List of links/urls - need a scraper/crawler/checker

Discussion in 'Black Hat SEO' started by ahaha1, Jul 30, 2017.

  1. ahaha1

    ahaha1 Newbie

    Joined:
    Jul 29, 2017
    Messages:
    2
    Likes Received:
    0
    Hi,

    I have a list of urls from an online retail store, they are all API product pages and display available product information (like title, description, sizes available) in simple text format.
    I need a tool that can check these pages and look for specific keywords/brand names so that I can easily filter all of the same brand product pages. The url itself only includes product ID so I can't simply filter the url list.

    Thanks in advance
     
  2. mindmaster

    mindmaster Jr. VIP Jr. VIP

    Joined:
    Sep 16, 2010
    Messages:
    2,874
    Likes Received:
    1,305
    Home Page:
    Try scrapebox addon google cache extractor if the pages are indexed.
     
  3. ahaha1

    ahaha1 Newbie

    Joined:
    Jul 29, 2017
    Messages:
    2
    Likes Received:
    0
    Thanks for the reply.
    Any unpaid options as I'm very new to all this and might only be a one-off task.