crawl

Hello, My site got affected on the previous Panda Update from Google, because my site was creating by mistake duplicate meta-tags every time we created new content, we fix all meta-tags, but it seems that is taking for ever to Google to crawl all of our site, so, my question is what is the...

Hi all, I'm crawling people's profiles ,and groups, on FB, i'm not sure this is this forum's purpose, but i usually see interesting stuff. My big problem is account creation (I need to be loged-in for crawling profiles) , after crawling for minutes/hours, the acc gets banned. if then i try to...

hello everybody: I'm a beginner. I registered a new domain name about "best sport bras", set up website with wordpress.has submit sitemap to google webmaster tools. Why Googlebot not crawling my site: googlebot just download a Sitemap, does not crawl to other wordpress url..

I have an individual page on site that had a url rewrite rule set up.. Apparently something was wrong and my page disappeared from my site for a few days. After I realized this happened, I fixed the issue and the page has been online since. However, the page went from being number 1 on google to...

My blog is having 10 article, after checking the blog with webmaster tool, i saw crawl errors saying url restricted by robot.txt wat can I do, and what does it mean

Hi, I'm obviously a newbie here. I need someone to find links to documents buried in a website. (What is the proper term for this?) I don't want to buy and learn software because this is the only time I need to do this. Thanks.

Hi, My domain has not been crawled for week according to market samurai. Is this normal? Also I have made some changes. Can I do something to force google to crawl my site? Thanks, R.