1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Indexing massive amount of URLs fast?

Discussion in 'Black Hat SEO' started by Robertas, Dec 17, 2015.

  1. Robertas

    Robertas Registered Member

    Joined:
    Sep 9, 2013
    Messages:
    50
    Likes Received:
    20
    Hey guys,

    I want to index a large site with more than 1M pages. Currently only ~60K pages indexed.
    What is the fastest way to make this happen?
    Can someone recommend me a software or tool to do this?

    Thank you.
     
  2. kickasss

    kickasss Regular Member

    Joined:
    Apr 3, 2015
    Messages:
    334
    Likes Received:
    86
    Occupation:
    FULL TIME IM.
    Location:
    BHW
    you should try an indexing service like indexification ,instant link indexer, express indexer one of these would be perfect to index your links
     
  3. smartboyhere

    smartboyhere Power Member

    Joined:
    Sep 24, 2013
    Messages:
    652
    Likes Received:
    321
    No indexing service index the links faster as before.
    But try with speed-links.
     
  4. Jumbuck1976

    Jumbuck1976 Regular Member

    Joined:
    Jun 13, 2015
    Messages:
    205
    Likes Received:
    37
    Occupation:
    Social media writer for a marketing company in Dub
    Location:
    Naas, Co Kildare, Ireland
    Just use anything like linklicious, instant indexer or the like.

    Upload and wait, you'll get them all indexed pretty quickly.
     
  5. conrulez

    conrulez Power Member

    Joined:
    Dec 29, 2009
    Messages:
    539
    Likes Received:
    428
    Gender:
    Male
    Location:
    USA
    Fast indexing is NOTHING like it used to be these days.

    Speed-links is OK. Not amazing but not crap either. But you're looking at an outrageous amount of links there. The other factor is this, being indexed is one thing, ranking is quite another.

    I've seen sites that with tens of 1000's of pages that I used to get indexed fairly quick now not index even half. Something has changed BIG TIME with indexing of sites. I've tried a LOT of different ways to get those type of sites indexed. Not having much success compared to before.

    Please share if you come up with a viable solution. I'd settle for 60-80% consistently indexed.
     
  6. ekapek

    ekapek Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 2, 2010
    Messages:
    273
    Likes Received:
    48
    Home Page:
  7. thejesus

    thejesus Registered Member

    Joined:
    Sep 29, 2008
    Messages:
    76
    Likes Received:
    22
    Speed-links isn't so good anymore, far too many people use it now and they can't keep up with demand. I used it before and it was really good, but I had to stop using it as it would take a week to process my links. The fastest indexing method I've found is a GSA blast, but indexing the hundreds of thousand of links that I need to isn't really possible.
     
  8. Jumbuck1976

    Jumbuck1976 Regular Member

    Joined:
    Jun 13, 2015
    Messages:
    205
    Likes Received:
    37
    Occupation:
    Social media writer for a marketing company in Dub
    Location:
    Naas, Co Kildare, Ireland
    If i remember right, hasn't Google changed how fast links are crawled now? Making services like instant link indexer not that instant anymore.

    Not to say these services aren't worth it, they still are pretty good and I use instant link indexer myself but you have to accept you won't get links indexed within hours anymore.
     
  9. ThopHayt

    ThopHayt Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 25, 2011
    Messages:
    6,679
    Likes Received:
    2,521
    Google indexes slower and they are PICKIER about which links they will and will not index.

    I think the questions that should be asked is: Which service gets the best index percentage, and the lowest de-indexation rate a month down the line.

    I've noticed that getting links indexed "fast" sometimes seems to correlate with the links dying later on. So the method matters. Quality matters.
     
  10. ekapek

    ekapek Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 2, 2010
    Messages:
    273
    Likes Received:
    48
    Home Page:
    It's not true what you said. Links are processed within max few hours from submit. Just read some last reviews http://www.blackhatworld.com/blackh...er-available-now-post8462325.html#post8462325

    Building tier2 is still the best method for indexing but needs time and money
     
  11. BobbyKhan

    BobbyKhan Registered Member

    Joined:
    Nov 6, 2013
    Messages:
    54
    Likes Received:
    5
  12. clevelandslim

    clevelandslim Jr. VIP Jr. VIP

    Joined:
    Nov 15, 2008
    Messages:
    1,924
    Likes Received:
    189
    Personally, I use mass ping for indexing large amount of urls
     
  13. edwinmichal

    edwinmichal Regular Member

    Joined:
    Jul 11, 2013
    Messages:
    427
    Likes Received:
    37
    Location:
    Searching...
    Try with creating sitemap
     
  14. EPC

    EPC Junior Member Premium Member

    Joined:
    Jun 12, 2014
    Messages:
    104
    Likes Received:
    13
    Home Page:
    fake <a href html codes on pastebin backlinked on wikis or reddit and definitely use a sitemap

    quick ranking
     
  15. ekapek

    ekapek Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 2, 2010
    Messages:
    273
    Likes Received:
    48
    Home Page:
    Take notice that deindexation does'nt curenttly mean that backlink isn't countet by google. I have made a lof of test on this and saw that even backlinks aren't show in index but previosuly was - the linked site keeps rank. Also as I said fast indexer + tier 2 is the best to rank
     
  16. BobbyKhan

    BobbyKhan Registered Member

    Joined:
    Nov 6, 2013
    Messages:
    54
    Likes Received:
    5
    Ok noted. I might try out speed links again.