Mr. Tokyo
Regular Member
- May 27, 2013
- 241
- 92
One a dedicated server with 1 GB connection and good specs:
- Loaded in 1600 keywords in the Keyword Scraper to scrape 4 levels deep.
- Selected all scrape sources and ran it.
Half hour later it's already scraped over 31.000 keywords, but there are always periods where it's extremely slow for a while like 10-15 minutes, then it speeds back up. It especially hangs at "Scraping from: Shopping.com Search Suggestions" and the Amazon source. Then it moves on to the next source which is fast, then it slows down again until it moves on to the next source. Google Suggest always seems to be the fastest of them all.
Sometimes I don't see any new keywords for about 20 minutes when I'm at around 100k scraped keywords. By then usually I abort the operation because I think it might have froze or something. Is this normal behavior or should I perhaps give it more time to scrape the keywords, like an entire day?
- Loaded in 1600 keywords in the Keyword Scraper to scrape 4 levels deep.
- Selected all scrape sources and ran it.
Half hour later it's already scraped over 31.000 keywords, but there are always periods where it's extremely slow for a while like 10-15 minutes, then it speeds back up. It especially hangs at "Scraping from: Shopping.com Search Suggestions" and the Amazon source. Then it moves on to the next source which is fast, then it slows down again until it moves on to the next source. Google Suggest always seems to be the fastest of them all.
Sometimes I don't see any new keywords for about 20 minutes when I'm at around 100k scraped keywords. By then usually I abort the operation because I think it might have froze or something. Is this normal behavior or should I perhaps give it more time to scrape the keywords, like an entire day?
Last edited:
