1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How I got over 20,000 Autoblog/Scraped Pages Indexed and bringing in Traffic

Discussion in 'Black Hat SEO' started by adbot, Apr 15, 2011.

  1. adbot

    adbot Power Member

    Joined:
    Feb 12, 2011
    Messages:
    512
    Likes Received:
    541
    Occupation:
    IM
    Location:
    New York
    I have had several people ask me recently how I set up my scraper sites/auto blogs. I'm far too lazy to answer everyone via PM so I decided to just spell it out in a post on the boards. Now keep in mind that this is just my setup, which has been working for me through all this Panda nonsense. I can't promise that everyone will have the same success and there may be better ways to do it. This is just my way and it's not rocket science either. I have a handful of these sites and somewhere in the range of 20 to 30 thousand pages indexed in Google. I have done zero link building on any of these and I don't send them any traffic but they all bring in traffic for low competition keywords. Totally organic. I built these mainly for link juice to other sites and they have served me well so far.

    All my scrapers run on wordpress and I use the same plugins on all of them. I will provide the list at the end. I also uploaded them all in one folder to mediafire, so you can grab them all in one spot if you so desire. I also use a nice theme and make a custom logo for each site using a free service at logosnap . com.

    It is important to make these sites look legit since the panda update. I also add the standard about, contact and privacy policy pages. All generic but again it adds to the credibility of the site in googles eyes. I use the feedwordpress plugin to scrape from rss feeds and I add about 200-300 pages a week to each site. I only select feeds that display the full posts, no excerpts. I set up a cron job on my server to update the feeds every 2-3 days. For the first month or two I do not run any adsense on these sites. I believe it builds trust this way, makes the sites look less spammy.

    Feedwordpress will create matching categories for all of your posts and you can configure it to attribute your site as the source for each post. For the first couple months I use the strip html plugin to strip all links from the posts (images too). This will ensure no backlinks to those pesky sites from whom you are yanking content. After I have around 1000 pages indexed i usually go ahead and unstrip the html, allowing all the links and images back in. I also add in my adsense or any affiliate links/banners. By this time you have earned googles trust so you are good to go. I use a number of other plugins for seo etc. Here is the list:

    All in One SEO - we all know what this is I hope
    Excerpt editor - I dont want anyone stealing my feed ;)
    Feed Wordpress - The scraper
    FWP + Strip HTML Tags from Posts - Self explanatory
    SEO Smartlinks - I use this to add my own links to the posts. It would be too much work to add links manually to 20k pages. with this you pick your keywords, tell it where to link em and it does the rest.
    SEO Wordspinner - If you want to spin the articles (I don't)
    Simple PIE Core - You need this in order for some plugins to function
    Tiny MCE Advanced - a useful plugin, stops wp from stripping your tags and breaks
    Google XML Sitemaps - to help with indexing
    CformsII - a great contact form plugin. I use it on all my wp sites.

    Heres where you can get these plugins:

    Code:
    http://www.mediafire.com/?a2am0pl4nfh425c
    and the virus total 0/41 Clean:
    Code:
    http://www.virustotal.com/file-scan/report.html?id=1ad16589e19249687e8652dc3e8c4417b1b821001183a390590de75e276e9ffd-1302822257
    Thats it, not much to it but it seems to work for me. I probably didn't cover every detail here but I will be happy to answer any questions you have. I hope this is useful to someone.


     
    • Thanks Thanks x 26
  2. jerra

    jerra Regular Member

    Joined:
    Sep 18, 2008
    Messages:
    476
    Likes Received:
    64
    Home Page:
    This is FANTASTIC!! thank you I'm currently in hospital but as soon as I get out I will give this a try!!

    Many thanks. Good post
     
    • Thanks Thanks x 1
  3. EddyD

    EddyD Regular Member

    Joined:
    Feb 6, 2011
    Messages:
    366
    Likes Received:
    169
    Occupation:
    I'm a writer!
    Location:
    London
    What about the $$?
     
  4. GrindcoreVlad

    GrindcoreVlad Newbie

    Joined:
    May 21, 2010
    Messages:
    45
    Likes Received:
    5
    Occupation:
    SEO Consultant
    Location:
    Cluj Napoca, Romania
    Yep tell us about the $$$. How much do you earn with these?
     
  5. formosa

    formosa Regular Member

    Joined:
    Apr 30, 2008
    Messages:
    309
    Likes Received:
    27
    Home Page:
    20,000 autoblogs ? does that mean 20,000 domains ?
     
  6. dadhere

    dadhere Newbie

    Joined:
    Nov 4, 2008
    Messages:
    34
    Likes Received:
    146
    good questions, hopefully we'll get an answer
     
  7. tanero

    tanero Newbie

    Joined:
    Jun 23, 2010
    Messages:
    23
    Likes Received:
    4
    Gender:
    Male

    20,000 Autoblog/Scraped Pages
     
  8. anhbloginc

    anhbloginc Regular Member

    Joined:
    Jul 15, 2009
    Messages:
    471
    Likes Received:
    76
    Gender:
    Male
    Location:
    New York
    The money you need to pay for renew about 20,000 domain it's really really problems.
     
  9. Ravasz

    Ravasz Registered Member

    Joined:
    Feb 16, 2011
    Messages:
    60
    Likes Received:
    7
    Location:
    EU
    Would be interested in knowing volume, and earnings numbers
     
  10. lizawwt

    lizawwt Registered Member

    Joined:
    Aug 26, 2010
    Messages:
    80
    Likes Received:
    12
    Looking at the plugins, I'm sure the op mean is 20,000 indexed pages on a single domain.
     
  11. 789abc

    789abc Registered Member

    Joined:
    Nov 26, 2010
    Messages:
    74
    Likes Received:
    74
    i also have a semi-scrap blog about entertainment news and it brings about 10 visitors from google per day via low competition KW. but till now i have no click from adsense. how do you monetize such site?
     
  12. jerzydawg

    jerzydawg Supreme Member

    Joined:
    Dec 24, 2010
    Messages:
    1,260
    Likes Received:
    422
    Anything can answer this question. Build backlinks....build them manually or go buy a service provided by members in the Selling forum.
     
  13. adbot

    adbot Power Member

    Joined:
    Feb 12, 2011
    Messages:
    512
    Likes Received:
    541
    Occupation:
    IM
    Location:
    New York
    Close. 20000 pages indexed over half a dozen domains.
     
  14. adbot

    adbot Power Member

    Joined:
    Feb 12, 2011
    Messages:
    512
    Likes Received:
    541
    Occupation:
    IM
    Location:
    New York
    They bring in a few bucks, your not gonna make a living off of these though. I did not create them to be big earners though. If they pay for themselves im happy. They are primarily for link juice. When I need to give an older whitehat site a boost, its nice to be able to blast 5 or 10 thousand links at it without blinking an eye. I took a clients site from bottom of page two to the top of page 1 for a competitive term (legal niche) recently by doing this.
     
  15. tobeto

    tobeto Junior Member

    Joined:
    Apr 10, 2010
    Messages:
    171
    Likes Received:
    19
    a very good guide, thanks very much
     
  16. jeancarlin

    jeancarlin Registered Member

    Joined:
    Nov 8, 2008
    Messages:
    82
    Likes Received:
    82
    Did you do this using:
    a) footer links
    b) blogroll links
    c) in context links on all/many posts

    Thank you.

    JC.
     
  17. adbot

    adbot Power Member

    Joined:
    Feb 12, 2011
    Messages:
    512
    Likes Received:
    541
    Occupation:
    IM
    Location:
    New York
    I used both b and c. A sitewide link on the sidebar as well as text links throughout the articles on the blog. I have no idea how many text links though as I used the seo smart links to add them in on auto.
     
  18. donduck

    donduck Junior Member

    Joined:
    May 9, 2007
    Messages:
    162
    Likes Received:
    17
    Location:
    Australia
    is this still working?
    adsense has being manually checking auto blog content on sites - and banning adsense
    accounts /or site adsense serving for spam content
     
  19. adbot

    adbot Power Member

    Joined:
    Feb 12, 2011
    Messages:
    512
    Likes Received:
    541
    Occupation:
    IM
    Location:
    New York
    still going strong. They cant manually check everything.
     
  20. technology notebook

    technology notebook Newbie

    Joined:
    Nov 29, 2009
    Messages:
    10
    Likes Received:
    3
    are you scrape content from rss feed? or from basic keyword? what plugin you use for scraped the content? Thanks you