1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scraping news site

Discussion in 'Black Hat SEO' started by Damat, Nov 20, 2013.

  1. Damat

    Damat Junior Member

    Joined:
    Oct 17, 2013
    Messages:
    102
    Likes Received:
    26
    Hello,
    I want to build website, but not regular website..
    I want to Scrap news site and copy all the article/news to my blog.

    what the right way to do it?
     
  2. rratovsky

    rratovsky Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 9, 2013
    Messages:
    128
    Likes Received:
    22
    Occupation:
    Affiliate Manager
    Location:
    BHW
  3. SEOShine

    SEOShine Registered Member

    Joined:
    Jul 12, 2013
    Messages:
    62
    Likes Received:
    5
    Agree with rratovsky, create the script or pay someone else to write it. But as I think more, wouldn't it be possible with RSS feeds - just use some basic plugin and place all the RSS in one page.

    P.S. If you are doing SEO on your site remember to block the search engines from accessing the specific page using the robots.txt.
     
  4. Veyron

    Veyron BANNED BANNED

    Joined:
    Jun 3, 2013
    Messages:
    1,452
    Likes Received:
    1,297
    So you're essentially wanting to build a "News" AutoBlog site. Simply purchase a $5 Gig on Fiverr for this. There's plenty of sellers who will set this up for you where it'll be built on WordPress and then they'll use Premium Plugins (At no cost to you) to extract the content from the sources you provide. This is a simple and affordable solution and will save you the head ache of setting it up yourself.

    Veyron
     
  5. Damat

    Damat Junior Member

    Joined:
    Oct 17, 2013
    Messages:
    102
    Likes Received:
    26
    Hi,
    Thank u for your comment.

    I build the blog (wordpress) with basic plugin (Auto Blog).
    I don't understand what the do you mean in your message about the "robots.txt".
    Why to block? and what to block?

    Thanks.
     
  6. Akihabara

    Akihabara Registered Member

    Joined:
    Aug 18, 2011
    Messages:
    86
    Likes Received:
    18
    Location:
    France
    Because if you copy the news on your site it will be duplicate content and you will be penalized.
     
  7. Damat

    Damat Junior Member

    Joined:
    Oct 17, 2013
    Messages:
    102
    Likes Received:
    26
    So, why make the site?
    block all the news page on the site?
    how it's help to my seo?
    or,
    maybe do you have any recommend?
     
  8. djp3k05

    djp3k05 Jr. VIP Jr. VIP

    Joined:
    Oct 30, 2010
    Messages:
    724
    Likes Received:
    218
    there was a plugin for WP that could scrape content for any given keyword, and could also rewrite the content not to give duplicate content. I don't remember the name now.....
     
  9. Akihabara

    Akihabara Registered Member

    Joined:
    Aug 18, 2011
    Messages:
    86
    Likes Received:
    18
    Location:
    France
    I recomand you to not copy the content of another website.
    You might be able to rank a few days, but you will by rapidly penalized.
    You have to get the news, rewrite and then post to your site.