yoyo33
Regular Member
- Jan 29, 2011
- 268
- 49
This is a big "waw"! It's first time when I think to use private proxies for scraping.
I didn't knew the eventual ban will be only for hours. I have 10 - 20 shared usually, not really private, but in time i think 100% private proxies will be a great investment.
And this will solve another issue. Some of "free public" proxies are botnet proxies and it's not a good idea to use them every day, you know, better stay safe.
Really? ~80 million urls?
I scraped last week 2.4 million and I was thinking it's too much. I have to think again.
Regarding %BLOGTITLE%. If you think it's possible to convince sweetfunny to include this in next updates it will be great. I use this even on moderated blogs and sometimes nice blog owners write responses at messages like "Hey, I like your %BLOGTITLE%.." or "you did a great job writing %BLOGTITLE%..."
I don't think this nice messages are evil in any way :saevil:, i see them like a nice encouragement for young bloggers. And of course we need their backlinks, so this is a win-win situation.
ps. you may want to edit your name from screen shot
I didn't knew the eventual ban will be only for hours. I have 10 - 20 shared usually, not really private, but in time i think 100% private proxies will be a great investment.
And this will solve another issue. Some of "free public" proxies are botnet proxies and it's not a good idea to use them every day, you know, better stay safe.
Really? ~80 million urls?
Regarding %BLOGTITLE%. If you think it's possible to convince sweetfunny to include this in next updates it will be great. I use this even on moderated blogs and sometimes nice blog owners write responses at messages like "Hey, I like your %BLOGTITLE%.." or "you did a great job writing %BLOGTITLE%..."
I don't think this nice messages are evil in any way :saevil:, i see them like a nice encouragement for young bloggers. And of course we need their backlinks, so this is a win-win situation.
ps. you may want to edit your name from screen shot