scraper

Discussion in 'Black Hat SEO Tools' started by seoreports, Sep 8, 2012.

  1. seoreports

    seoreports Junior Member

    Joined:
    Aug 26, 2012
    Messages:
    151
    Likes Received:
    34
    What kind of scraper should I build? I've built an article scraper, and am thinking of adding more article directories to it -- what other scrapers would you want access to?
     
  2. keval007

    keval007 Junior Member

    Joined:
    Jun 12, 2012
    Messages:
    144
    Likes Received:
    26
    Occupation:
    Web Scraper & PHP Developer
    In which language you are making this scraper?


    You can made Emails scraper, Yelp scraper, Google SERPs scraper and many more..
     
  3. seoreports

    seoreports Junior Member

    Joined:
    Aug 26, 2012
    Messages:
    151
    Likes Received:
    34
    it would be web-based, so PHP.
     
  4. Tones0000

    Tones0000 Registered Member

    Joined:
    Feb 13, 2012
    Messages:
    76
    Likes Received:
    4
    Occupation:
    IM
    Location:
    I'm from Alabama.
    Make a bot that scrapes a bunch of tumblr blogs, checks the pr, takes all the ones 2 or higher and scrapes the post and then individually likes them so you get a shit load of good back links.
     
  5. keval007

    keval007 Junior Member

    Joined:
    Jun 12, 2012
    Messages:
    144
    Likes Received:
    26
    Occupation:
    Web Scraper & PHP Developer
    You can also build Alexa Rank scraper and Proxy scrapper. Which library you are using in PHP? SimpleHTMLDom? cURL?
     
  6. Tones0000

    Tones0000 Registered Member

    Joined:
    Feb 13, 2012
    Messages:
    76
    Likes Received:
    4
    Occupation:
    IM
    Location:
    I'm from Alabama.
    Do you have a picture scraper?
     
  7. moonlighsunligh

    moonlighsunligh Jr. VIP Jr. VIP

    Joined:
    May 1, 2010
    Messages:
    2,097
    Likes Received:
    329
    Home Page:
    Make something like IAW - instant article wizard. Is it possible to scrape article out of any site without scraping a bunch of no-sense html tags, not just from an article directory(where the structure of the site is known in advance).

    Maybe with something like outertext + using just few paragraphs from the code directly bellow H1 tag?
     
  8. seoreports

    seoreports Junior Member

    Joined:
    Aug 26, 2012
    Messages:
    151
    Likes Received:
    34
    DOMDocument + curl

    I have not had a need for a picture scraper, Scrapebox has a built in image scraper for Google images.

    I might do this, I've already written a web-based article scraper that scrapes 3 of the most popular article directories.
     
  9. gash73

    gash73 Newbie

    Joined:
    Feb 19, 2012
    Messages:
    6
    Likes Received:
    3
    amazon product scraper
     
  10. Tones0000

    Tones0000 Registered Member

    Joined:
    Feb 13, 2012
    Messages:
    76
    Likes Received:
    4
    Occupation:
    IM
    Location:
    I'm from Alabama.
    Could you make a scraper that scrapes the HMA online proxy list?