1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to extract blog posts URL's from Blogs?

Discussion in 'Black Hat SEO' started by eagleshot, May 1, 2010.

  1. eagleshot

    eagleshot Junior Member

    Joined:
    Dec 30, 2009
    Messages:
    186
    Likes Received:
    85
    Home Page:
    I'm looking to find an easy way to extract blog post URL's from Blogs. Can I use scrapebox or any other program for this? I don't think scrapebox will work because it automatically deletes duplicate URL's. I have a list of blogs that are high PR. I want to harvest every single blog post and run it through scrapebox.

    Any help would be appreciated!
     
  2. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 13, 2008
    Messages:
    1,747
    Likes Received:
    5,039
    Location:
    ScrapeBox v2.0
    Home Page:
    Options >> Automatically Remove Duplicate Domains (Untick)

    The next version the Options menu will be renamed "Do Not Open" so everyone opens it and finds the options. :D
     
  3. eagleshot

    eagleshot Junior Member

    Joined:
    Dec 30, 2009
    Messages:
    186
    Likes Received:
    85
    Home Page:
    I need to extract every single page from a URL. How do I do that?
     
  4. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 13, 2008
    Messages:
    1,747
    Likes Received:
    5,039
    Location:
    ScrapeBox v2.0
    Home Page:
    You have many options, you can harvest site:blog.com in the harvester, you can use the Sitemap Scraper Addon if the blog has a sitemap and rip all the URL's that way, or you can use the Link Extractor Addon which will extract every link out of every page you feed it.
     
  5. eagleshot

    eagleshot Junior Member

    Joined:
    Dec 30, 2009
    Messages:
    186
    Likes Received:
    85
    Home Page:
    Thanks Mate... I will try that! I also just DL a free URL extractor.