Recent content by serge.w1lllliii

  1. S

    Alternative tools to Scarpebox 64 Bit

    Hey, I have own crawler and can scrape site for you, checkout my thread "Free Web Site Crawling [LARGE!]" write me PM
  2. S

    Free Web Site Crawling [LARGE!]

    Hi all! I'm developing web crawler for big websites (1-10 millions pages) more than half a year. Now I testing it on everything. What I store: - page info: titles, desc, headers, status code, load time, distance to index, out links, in links, more than 20 attributes - links: anchor, follow...
Back
Top