1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

scraper

Discussion in 'Black Hat SEO Tools' started by seoreports, Sep 8, 2012.

  1. seoreports

    seoreports Junior Member

    Joined:
    Aug 26, 2012
    Messages:
    151
    Likes Received:
    34
    What kind of scraper should I build? I've built an article scraper, and am thinking of adding more article directories to it -- what other scrapers would you want access to?
     
  2. keval007

    keval007 Junior Member

    Joined:
    Jun 12, 2012
    Messages:
    145
    Likes Received:
    26
    Occupation:
    Web Scraper & PHP Developer
    In which language you are making this scraper?


    You can made Emails scraper, Yelp scraper, Google SERPs scraper and many more..
     
  3. seoreports

    seoreports Junior Member

    Joined:
    Aug 26, 2012
    Messages:
    151
    Likes Received:
    34
    it would be web-based, so PHP.
     
  4. Tones0000

    Tones0000 Registered Member

    Joined:
    Feb 13, 2012
    Messages:
    76
    Likes Received:
    4
    Occupation:
    IM
    Location:
    I'm from Alabama.
    Make a bot that scrapes a bunch of tumblr blogs, checks the pr, takes all the ones 2 or higher and scrapes the post and then individually likes them so you get a shit load of good back links.
     
  5. keval007

    keval007 Junior Member

    Joined:
    Jun 12, 2012
    Messages:
    145
    Likes Received:
    26
    Occupation:
    Web Scraper & PHP Developer
    You can also build Alexa Rank scraper and Proxy scrapper. Which library you are using in PHP? SimpleHTMLDom? cURL?
     
  6. Tones0000

    Tones0000 Registered Member

    Joined:
    Feb 13, 2012
    Messages:
    76
    Likes Received:
    4
    Occupation:
    IM
    Location:
    I'm from Alabama.
    Do you have a picture scraper?
     
  7. moonlighsunligh

    moonlighsunligh Jr. VIP Jr. VIP Premium Member

    Joined:
    May 1, 2010
    Messages:
    1,623
    Likes Received:
    218
    Make something like IAW - instant article wizard. Is it possible to scrape article out of any site without scraping a bunch of no-sense html tags, not just from an article directory(where the structure of the site is known in advance).

    Maybe with something like outertext + using just few paragraphs from the code directly bellow H1 tag?
     
  8. seoreports

    seoreports Junior Member

    Joined:
    Aug 26, 2012
    Messages:
    151
    Likes Received:
    34
    DOMDocument + curl

    I have not had a need for a picture scraper, Scrapebox has a built in image scraper for Google images.

    I might do this, I've already written a web-based article scraper that scrapes 3 of the most popular article directories.
     
  9. gash73

    gash73 Newbie

    Joined:
    Feb 19, 2012
    Messages:
    4
    Likes Received:
    1
    amazon product scraper
     
  10. Tones0000

    Tones0000 Registered Member

    Joined:
    Feb 13, 2012
    Messages:
    76
    Likes Received:
    4
    Occupation:
    IM
    Location:
    I'm from Alabama.
    Could you make a scraper that scrapes the HMA online proxy list?