Is there a risk in scraping without proxy?

A

aferguson3

Registered Member

Mar 21, 2012

73

9

• Apr 3, 2012

• #1

When I scrape my private IP's die pretty much instantly, so I was wondering how safe is it to scrape blog urls without using a proxy and then using the proxies to post comments?

 

acotut

Elite Member

Dec 1, 2010

2,381

1,083

• Apr 3, 2012

• #2

aferguson3 said:

When I scrape my private IP's die pretty much instantly, so I was wondering how safe is it to scrape blog urls without using a proxy and then using the proxies to post comments?

Click to expand...

You usually need proxies for scraping mostly,not for comments

 

S

Sophomoric

Junior Member

Aug 4, 2011

115

10

• Apr 3, 2012

• #3

Scrape with public proxies, post with private. Sorted

 

zacatictac

Power Member

May 2, 2010

660

805

• Apr 3, 2012

• #4

eventually google will ban your ip for too many requests. If your doing huge amounts of scraping then yes you need proxies and lots of them If your just trying to scrape a few thousand urls then you dont really need them

 

H

hollandgirl68

Registered Member

Jul 27, 2009

58

11

• Apr 3, 2012

• #5

I would stick with the proxies, you do not want to risk it with google.

 

nimmivh

Regular Member

Jul 21, 2011

313

63

• Apr 3, 2012

• #6

If you too much search queries to google, they may temporarily block your IP

Do it with some public proxies
Why should we take risk in this case ?

 

johnfun

Junior Member

Sep 4, 2009

133

229

• Apr 3, 2012

• #7

no big risk .. BUT a temporaty bann for few mins ... nothing else ..BUT still prox are always suggested ..specially priovate or shared

 

DarthM

Regular Member

Dec 17, 2011

465

420

• Apr 3, 2012

• #8

Yep your IP will get temp banned, so it'll hamper your scraping.

 

zerocoolflo

Power Member

Feb 7, 2011

527

175

• Apr 3, 2012

• #9

Threre's absolutely no risk if you can change your ip after it's been blocked

 

T

TheBacklinkProdigy

BANNED

Apr 1, 2012

70

137

• Apr 6, 2012

• #10

If you have a dynamic IP you would be fine since you'd just switch off your cable modem and or router (at the same time, wait 5 - 10 minutes) and everything would reset and give you the new IP. If you have a static IP it might be wise to just use a program that harvests proxies real quick and just delete dups from them, and it won't hurt to take the extra time to make sure your IP doesn't get banned if indeed it is static.