1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

crawling

Discussion in 'Black Hat SEO' started by Geasy, Mar 11, 2017.

  1. Geasy

    Geasy Jr. VIP Jr. VIP

    Joined:
    Jul 26, 2016
    Messages:
    712
    Likes Received:
    128
    How much it should take google to crawl a site?

    I bought a pbn, built a sitemap, sent to google. It crawled only it's homepage. I made in it about 30 posts but none is crawled.
     
  2. Geasy

    Geasy Jr. VIP Jr. VIP

    Joined:
    Jul 26, 2016
    Messages:
    712
    Likes Received:
    128
    Thanks you were so helpful. I hope your posts get more by time
     
  3. MrRobot15

    MrRobot15 Newbie

    Joined:
    Dec 21, 2016
    Messages:
    28
    Likes Received:
    8
    Gender:
    Male
    Occupation:
    Freelance- Software enthusiast
    Location:
    Everywhere
    What exactly do you want to crawl?it depends
     
  4. danparks

    danparks Junior Member

    Joined:
    Sep 26, 2011
    Messages:
    170
    Likes Received:
    60
    The past month or so I've noticed that crawling and indexing has gotten much slower. I never used to worry about it. I'd start a new site, or add a new post to an existing site, and usually within a couple of days things were indexed (not ranked, just talking about indexing). With the crazy Google algorithm updates of late, maybe Google is devoting much more of their resources to crawling and recrawling existing pages, and less to new pages.
     
  5. KHer0

    KHer0 Supreme Member

    Joined:
    Mar 22, 2011
    Messages:
    1,342
    Likes Received:
    1,224
    Occupation:
    Architect
    You should have told us hwhen did you postcur sitemap. Dont worry it take at least 7 - 10 days. After 10 days us fetch as google and it will get indexed within minutes lop
     
  6. xReminisce

    xReminisce Regular Member

    Joined:
    Dec 29, 2012
    Messages:
    433
    Likes Received:
    229
    Occupation:
    Spy
    Home Page:
    It is really hard to say
    sometimes it takes forever for it to begin to crawl
    May take a few more days, or another month
    which makes it very unpredictable

    and don't listen to the ones who are telling u to fetch as google
    stupid af idea to do that to a PBN site.
     
  7. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,487
    Likes Received:
    11,187
    Occupation:
    CHEAP
    Location:
    DATASETS
    Home Page:
    When did this site go live and when did you submit it ?
     
  8. Geasy

    Geasy Jr. VIP Jr. VIP

    Joined:
    Jul 26, 2016
    Messages:
    712
    Likes Received:
    128
    9 March I did both of them.
     
  9. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,487
    Likes Received:
    11,187
    Occupation:
    CHEAP
    Location:
    DATASETS
    Home Page:
    Too new mate. Give it more time.
     
    • Thanks Thanks x 1
  10. KHer0

    KHer0 Supreme Member

    Joined:
    Mar 22, 2011
    Messages:
    1,342
    Likes Received:
    1,224
    Occupation:
    Architect
    Believe it or not I use google to index all my websites and all pages appear within top 30 after minutes of Indexing Rquest. However, I don't think someone building PBN is smart enough no to use his default webmaster account to index his backlinks

    @OP : Like I said before, at least give it from 1 week to 10 days. Another website of mine took 3 weeks to index inner pages and not all of them. You can also use add new url service from google which doesn't require webmaster verification, I use it to index all my web 2.0 Network
     
  11. danparks

    danparks Junior Member

    Joined:
    Sep 26, 2011
    Messages:
    170
    Likes Received:
    60
    Right. When I say I've noticed a big delay in crawling/indexing, I'm referring to posts on PBN sites, or new PBN sites I create. So yeah, I don't submit them to Google (no GWT for these sites).

    I don't have any recent experience with getting new posts on money sites crawled/indexed (no sites in GWT). Am a little curious if requesting a crawl from GWT still works as quickly as it used to.


     
  12. Renfield-Files

    Renfield-Files Junior Member

    Joined:
    Feb 13, 2017
    Messages:
    120
    Likes Received:
    57
    Gender:
    Male
    Occupation:
    IT Manager
    Location:
    Sao Paulo
    Am I the only 1 who trust SiteVisitor? No harm and Im using it since late 2015. I post, wait 10-20 minutes and ignite SiteVisitor. For brand new sites it doesnt take long also. Sure, some linkback from my old web 2.0 blogs helps.
     
  13. danparks

    danparks Junior Member

    Joined:
    Sep 26, 2011
    Messages:
    170
    Likes Received:
    60
    Forgive my ignorance, but what is SiteVisitor? URL, please? Thanks.

     
    • Thanks Thanks x 1
  14. Renfield-Files

    Renfield-Files Junior Member

    Joined:
    Feb 13, 2017
    Messages:
    120
    Likes Received:
    57
    Gender:
    Male
    Occupation:
    IT Manager
    Location:
    Sao Paulo
    google sitevisitor.exe but be careful about the source of your download. I paid mine. Coming with 2k proxies. 40% very good ones. I did tweak some files and now I can auto-update my proxy lists directly from free-proxy-list.net