1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[Method] Finding Articles Directories for AMR without Footprints

Discussion in 'Black Hat SEO' started by ct2272, Feb 13, 2012.

  1. ct2272

    ct2272 Registered Member

    Joined:
    Nov 13, 2010
    Messages:
    56
    Likes Received:
    44
    One of the problems I have always had with Scrapebox footprints was for me they can take forever to produce a result using public proxies or will often burn out my bandwidth quota if I am using private proxies. The last time I used footprints for article directories it took me a week to generate the list and the end result was a slight incremental increae in the amount of directories that were valid after importing them into AMR.

    With that said, I have come up with a way to create import lists faster and more efficiently. In a nutshell it goes on the premise of finding AA URLs except for article directories. My typical AMR blast before I figured this out was 274 submitted/100 auto approved. After 1 pass of importing URLs into AMR I was able to increase my result to 700 submitted/300 auto approved.

    What you will need:
    1. An AA list for an AMR article you have submitted.
    2. Scrapebox Link Extractor
    3. Scrapebox Backlink Checker
    4. AMR

    Steps:
    1. Take the AA list for the article you have and import it into Scrapebox.
    1a. Trim the list to the root domain.
    1b. Remove duplicate domains.

    This will leave you with a site list that you will be able to load into the Link Extractor add-on.

    2. Load the Link Extractor add-on and set to Internal links.
    2a. Import the list from the Harvestor.
    2b. Hit 'Start'.

    The Link Extractor will go to each url and attempt to scrape the entire site. You are ultimately searching for articles because within those articles are the backlinks to the author's site. Once the Link Extractor has worked, Export the list to somewhere you can import it again into the Harvestor. I have noticed with the this add-on that it only seems to go down 1 level into the site. So it is necessary to repeat steps 2 - 3 a few times.

    3. Remove Duplicate URLs
    3a. Remove URL Containing the Word, author
    3b. Remove URL Containing the Word, category
    3c. Remove URL Containing the Word, tag

    Step 3 is not really necessary but my end goal is to build up a list where the url contains "domain.name/article.name" because that is where you will find the author's anchor text. For efficiency I just removed what I have deemed "non essential" URLs.

    4. Repeat Step 2 - 3 until you have a large list of "domain.name/article.name" URLs.
    5. Change the Link Extractor to now be External.
    6. Import the last list into the Link Extractor that you were able to generate from Steps 2 - 3.
    7. Start

    You're going to end up with all of the External links from these pages which will contain the author's anchor text URL (the goal).

    8. Load the Scrapebox Backlink Checker.
    8a. Take the last list you had and import it into the Backlink Checker.
    8b. Start
    8c. Download Backlinks

    The result after step 8 will be a list of article directories (and every other backlink method) from these domains.

    9. Trim this list to the root domain.
    10. Import into AMR

    My result from this test was a list of about 125,000 to import. I ended up with 20% that were accepted by AMR. After signing up and removing the errors I ended up with a list of about 4,000 with a submitted result of 15% and an auto approve result of around 9%.
     
    • Thanks Thanks x 18
  2. longrun

    longrun Junior Member

    Joined:
    Jan 27, 2011
    Messages:
    127
    Likes Received:
    10
    This sounds like a classic case of "no pain no gain"! How long did this take to accomplish?
     
  3. ct2272

    ct2272 Registered Member

    Joined:
    Nov 13, 2010
    Messages:
    56
    Likes Received:
    44
    Working out the method took about 20 minutes on a treadmill.

    The actual implementation and getting a list together to import is just a few hours. For me it cut down the time about 5 days. It took me that long to scrape footprints.
     
  4. randolph60

    randolph60 Junior Member

    Joined:
    May 13, 2011
    Messages:
    191
    Likes Received:
    48
    Hi,

    it works like a charm and it brought many new sources.

    Thousand thanks for the hint.


    Randolph
     
  5. madoctopus

    madoctopus Supreme Member

    Joined:
    Apr 4, 2010
    Messages:
    1,249
    Likes Received:
    3,498
    Occupation:
    Full time IM
    props for thinking out of the box but you're making it way too complicated. you either don't have enough proxies, you don't know how to scrape or both. it is much more reliable to use footprints to scrape but there's a catch. most people don't know how to properly scrape. they use too few seed keywords. I use about 60,000 keywords to scrape. every 10,000 keywords might give me just several hundred URLs more but in the end I have a list of about XXX,XXX distinct domains scraped.
     
    • Thanks Thanks x 2
  6. SuperNoobInc

    SuperNoobInc Regular Member

    Joined:
    Dec 28, 2011
    Messages:
    467
    Likes Received:
    32
    Thanks for sharing your think outside the box method, appreciated.
    However, the results dont seem to be appealing at all; In the end, we are seeing only 54 auto-approved directories?

    15% of 4000 = 600
    9% of 600 = 54...
     
  7. Risaharada

    Risaharada Junior Member

    Joined:
    Oct 27, 2010
    Messages:
    105
    Likes Received:
    30
    Very good method, if we keep this method to scrape AA sites everyday, we'll get enough AA sites.
     
  8. keebs

    keebs Newbie

    Joined:
    Mar 3, 2012
    Messages:
    1
    Likes Received:
    0
    I have never scraped. I downloaded Sick Scraper and will probably buy Scrape Box. What is the AA list for AMR? I have AMR need to get better directories since the included directors are over used.

    Thanks!
     
  9. ct2272

    ct2272 Registered Member

    Joined:
    Nov 13, 2010
    Messages:
    56
    Likes Received:
    44
    You're right and that was the way I was doing it. I was taking every footprint I could find and then crossing it with every word in the dictionary and it was taking me weeks to create lists. Public proxies only though because I only have 10 private proxies I use for bookmarking and so forth.
     
  10. Scorched87

    Scorched87 Newbie

    Joined:
    Dec 14, 2011
    Messages:
    13
    Likes Received:
    3

    What is the last list? The links that were external? What websites do you check these against?
     
  11. helio777

    helio777 Junior Member

    Joined:
    Jun 4, 2011
    Messages:
    128
    Likes Received:
    52
    Those 125K urls obviously include various and sundry blog platforms as well (wordpress, vbulletin, etc) - why didn't you mention posting to those (non-AMR) sites using scrapebox?
     
  12. MikeBuyco

    MikeBuyco Regular Member

    Joined:
    Mar 30, 2010
    Messages:
    255
    Likes Received:
    35
    Occupation:
    IT
    Location:
    Philippines
    Home Page:
    I never had good results with scraping with keywords or footprints in Scrapebox so I'm going to try your method. Thanks for sharing.
     
  13. eng152

    eng152 Power Member

    Joined:
    Apr 1, 2008
    Messages:
    663
    Likes Received:
    2,068
    Occupation:
    Engineer
    Location:
    Port 80
    Home Page:
    Superb method mate. This can be repeated for other types of backlinks as well. Hint: pligg sites :D
     
  14. krilin50

    krilin50 Regular Member

    Joined:
    Oct 26, 2008
    Messages:
    251
    Likes Received:
    18
    Occupation:
    online marketing manager
    Location:
    London
    I have been using a similar method since it's getting tougher to scrape long lists using scrapebox and it comes down to the quality of those URLs, right?

    thanks for confirming I'm on the right path, cheers
     
  15. webmasterbd

    webmasterbd Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 2, 2009
    Messages:
    2,568
    Likes Received:
    2,120
    Occupation:
    Internet marketer,designer,blogger & many more....
    Location:
    HELL!!
    Home Page:
    Hmm...it sounds good!i will do a scrapebox scraping using your methods & let you guys know if it really works or not.
     
  16. KeijoKala

    KeijoKala Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 16, 2008
    Messages:
    568
    Likes Received:
    120
    Now this is gold! If you have tool like ultimate demon you can add that final list and get pretty good new sites in your tool ;)
     
  17. dujow

    dujow Junior Member Premium Member

    Joined:
    Dec 31, 2010
    Messages:
    144
    Likes Received:
    53
    Location:
    Canada
    Well, I've been following the instructions of your guide step by step. I got to the backlink checker part, but forgot about it not working anymore! Thought I would try again anyway but low and behold, 0 backlinks found for every site. :( Any easy step to get the backlinks short of searching each and every site one at a time?
     
  18. Roland32

    Roland32 Regular Member

    Joined:
    Sep 16, 2011
    Messages:
    237
    Likes Received:
    45
    Anyone figure out a way to get this method to work again?