1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to build your own site lists for GSA SER

Discussion in 'Black Hat SEO Tools' started by davids355, Nov 26, 2015.

  1. davids355

    davids355 Jr. VIP Jr. VIP

    Joined:
    Apr 25, 2011
    Messages:
    10,198
    Likes Received:
    7,849
    Home Page:
    Just a quick guide that will show you how to scrape your own lists for using with GSA SER - of course GSA SER has its own built in tool for scraping URLs to post to, but its not that great and also it means using resources that you really want to reserve for actually posting to URLs rather than finding them.

    Things you will need:


    • GSA SER (Of course).
    • Scrapebox
    • Proxies - 30 shared proxies will do fine

    STEP 1: Getting the list of footprints together

    First of all you need a list of footprints and preferably the ones that GSA actually uses - you can get these by opening GSA then going to options, tools and clicking on "search online for URLs".
    Once in there you can go through the engines one by one and select "Add all footprints for...". This will gradually compile a list of all the footprints that you need.
    Once you have them you can tick the "Save to file" box or just copy and paste them into a text file.

    [​IMG]

    [​IMG]

    [​IMG]

    Once you have done this for all engines you should end up with around 2300 footprints.

    STEP 2: Getting the list of keywords together

    The next thing you need is a list of keywords - I normally do this for each project so that I get a targeted list of keywords and end up with a relatively unique if not perfectly targeted list of URLs at the end of it all.

    So open up Scrapebox and click on Scrape and then keyword scraper.

    [​IMG]

    Put a couple of seed keywords in here for your niche and then click on Start. Once it completes click on "Transfer results to left side" and then click start again. Leave it running for a while until you get a nice list of keywords.

    [​IMG]

    [​IMG]

    Once you have this list export it to a text file.

    [​IMG]

    STEP 3: Merging your list of keywords with your footprints to create a list of Google search queries.

    Go back to the main Scrapebox screen, clear anything currently in the keyword section and import your list of keywords that you previously scraped.

    Then click on "M" and import your list of footprints as well - this will merge the two together to create a nice list of search queries.

    Personally when I do this I use around 2500 keywords along with the 2300 footprints and this gives you around 5 million queries - if you have more keywords than that you can reduce it down using Dup remove - instructions included in the next step.

    Once you have the list of keyword+footprint combinations save them to a new text file.

    [​IMG]

    STEP 4: Randomizing and splitting your list

    This isnt imperative but I normally randomize my list so that I get an even amount of URLs for all of the different platforms. I also normally split my list because I don't need to scrape using 5 million queries.
    So if you goto addons in scrapebox and install dup remove you can acheive this easily.
    Once installed open dup remove and first randomize the list and then open that randomized list and split it. I personally split my lists into 10k files and then scrape using those one at a time.

    [​IMG]

    [​IMG]


    STEP 5: Begin harvesting

    Now that you have a set of 10,000 randomized keyword+footprint combinations you can import them back into scrapebox and begin scraping - just make sure you clear anything already in the keyword section, import the 10k list and then click on "Start harvesting".

    With 30 proxies and a 4 core VPS I normally leave this running for 12-24 hours and then stop it. This should give you 1-2 million URLs.

    Once that is complete close the harvester and they will be transfered into the main window where you can remove duplicates and then save the list.

    [​IMG]

    STEP 6: Sorting the list in to GSA

    Once you have this list it needs to be sorted in to GSA. This can be done by clicking on options, tools and then Import URLs. In my experience importing a file often fails so I open the text file first, copy all URLs and then use the procedure above but select "Import from clipboard". Once you have done that GSA will start looking through the list and importing them into its "Identified" list.

    STEP 7: Start posting

    Importing 2 million URLs will probably give you somewhere between 300k - 500k URLs that GSA can post to and once you have that you are good to go.

    [​IMG]

    LPM after using this method:

    [​IMG]
     
    • Thanks Thanks x 24
  2. thebigweb

    thebigweb Regular Member

    Joined:
    Nov 19, 2007
    Messages:
    356
    Likes Received:
    135
    Location:
    The Moon
    Home Page:
    That's a really great guide. Nice one.
     
    • Thanks Thanks x 1
  3. rabbitking

    rabbitking Elite Member

    Joined:
    Sep 24, 2013
    Messages:
    1,712
    Likes Received:
    3,580
    Straight to the point guide. Very nice David!
     
    • Thanks Thanks x 1
  4. Andres1986

    Andres1986 Jr. VIP Jr. VIP

    Joined:
    Sep 14, 2011
    Messages:
    2,551
    Likes Received:
    543
    Gender:
    Male
    Occupation:
    Digital Marketing Expert, Affiliate Marketer
    Home Page:
    Amazing guide! Should be a sticky and mandatory reading for all newbies getting into SEO automation.
     
  5. badaz

    badaz Regular Member

    Joined:
    Mar 3, 2013
    Messages:
    364
    Likes Received:
    87
    very interesting guide op thank you
     
  6. DeadJoe

    DeadJoe Power Member

    Joined:
    May 18, 2014
    Messages:
    557
    Likes Received:
    272
    Location:
    The Oblivion
    That looks awesome davids, I was searching for something similar. Good job without the fluff straight to the point. Thank you
     
  7. T0NYS

    T0NYS Supreme Member

    Joined:
    Jun 21, 2014
    Messages:
    1,340
    Likes Received:
    1,031
    Gender:
    Male
    Location:
    #Alb-IT
    you should be promoted asap David , great share :)
     
  8. V

    V Elite Member

    Joined:
    May 18, 2012
    Messages:
    2,297
    Likes Received:
    2,591
    Occupation:
    Student
    Location:
    /tmp
    Very nice guide mate :) I have been doing this same process for building my own site lists for quite some time now :)
     
  9. Array Experts

    Array Experts Jr. VIP Jr. VIP

    Joined:
    Sep 26, 2015
    Messages:
    496
    Likes Received:
    190
    Occupation:
    I Don't Know
    Location:
    Internet
    Home Page:
    Nice! Guide Very Clean Information
     
  10. Cryogenesis

    Cryogenesis Jr. VIP Jr. VIP

    Joined:
    Sep 1, 2013
    Messages:
    1,755
    Likes Received:
    2,445
    Gender:
    Male
    Location:
    India
    Home Page:
    Bookmarked for future reference.
    Good job man. :)
     
  11. davids355

    davids355 Jr. VIP Jr. VIP

    Joined:
    Apr 25, 2011
    Messages:
    10,198
    Likes Received:
    7,849
    Home Page:
    Thanks guys :) Glad you like it, its probably quite simple process to most but for anyone starting out with GSA hopefully its useful :)
     
  12. Skyebug77

    Skyebug77 Jr. VIP Jr. VIP

    Joined:
    Mar 22, 2012
    Messages:
    2,017
    Likes Received:
    1,423
    Occupation:
    Marketing
    Location:
    Portland,Or
    Don't want to sound like Im repeating other posters, but this is a great post. I know when I first used GSA this would have come in handy. GSA looks intimidating as a newb so this will certainly come in handy for those just starting out.
     
  13. mistaree

    mistaree Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 24, 2015
    Messages:
    167
    Likes Received:
    44
    As a newbie, this guide is a massive help :) thank you.
     
  14. asap1

    asap1 BANNED BANNED

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,185
    Nice and easy, good post here for the new guys.
     
  15. nicefor

    nicefor Regular Member

    Joined:
    Jun 20, 2014
    Messages:
    356
    Likes Received:
    140
    Occupation:
    Unemployed - Self Employed
    Location:
    Greece
    seems like a very nice guide!
     
  16. davids355

    davids355 Jr. VIP Jr. VIP

    Joined:
    Apr 25, 2011
    Messages:
    10,198
    Likes Received:
    7,849
    Home Page:
    Thanks for the comments guys, glad it's appreciated.
     
  17. Dokezar

    Dokezar Regular Member

    Joined:
    Sep 21, 2015
    Messages:
    320
    Likes Received:
    201
    Gender:
    Male
    Location:
    India
    Great guide dude!! :)
     
    • Thanks Thanks x 1
  18. davids355

    davids355 Jr. VIP Jr. VIP

    Joined:
    Apr 25, 2011
    Messages:
    10,198
    Likes Received:
    7,849
    Home Page:
    Thanks mate :)
     
  19. xrfanatic

    xrfanatic Jr. VIP Jr. VIP

    Joined:
    Aug 28, 2010
    Messages:
    419
    Likes Received:
    176
    Location:
    http://bit.ly/slb64
    Home Page:
    Short, but effective guide, lot's of BHW members are going to benefit from that for sure. Good job OP !
     
  20. ch2arn2ain1

    ch2arn2ain1 Registered Member

    Joined:
    May 24, 2015
    Messages:
    63
    Likes Received:
    3
    David yoj hace done a really good job, thanks