IP Blocked when checking Index

R

RisingMoon

Registered Member

Mar 23, 2013

80

2

• Jul 24, 2013

• #1

IP Blocked when checking Index

Using 9 private proxies.

Any idea why this is happening? Proxies are bad?

 

monkid

Power Member

Jan 2, 2010

679

312

• Jul 24, 2013

• #2

What tool are using? I guess it is scrapebox.

Of course your IP will be block if you are checking a lot of url, but you can always use proxies for that. Scrape proxies that Google passed and check your index again.

Hope that help.

 

R

RisingMoon

Registered Member

Mar 23, 2013

80

2

• Jul 24, 2013
• Thread Starter Thread Starter

• #3

They were already passed but then return IP BLOCKED after a minute or so of Index checking

 

H

hpv222

Power Member

Feb 8, 2010

751

279

• Jul 24, 2013

• #4

The proxies will get temp banned too, you can try decreasing the number of connections, it will take longer, but reduces the chances of the ips / proxies getting temp banned.

 

monkid

Power Member

Jan 2, 2010

679

312

• Jul 24, 2013

• #5

It is depend on how many urls do you check. If you are talking about 1k urls and you have 10 proxies, of course it will be blocked. Give us the figure here so we know exactly what your problems.

 

R

RisingMoon

Registered Member

Mar 23, 2013

80

2

• Jul 24, 2013
• Thread Starter Thread Starter

• #6

9000 Urls with 10 proxies.

No need to be rude, I can harvest a lot of URLS with them so it does not make sense that they get banned for another task using the same program.

 

monkid

Power Member

Jan 2, 2010

679

312

• Jul 24, 2013

• #7

That's too different thing harvesting and checking the index. I personally experience this, I can scrape a lot of urls using few proxies but when I check index, it will be block very fast.

9000 urls and 10 proxies, now I can see exactly your problems! You should use a lot of proxies. Scrape proxies more than 100+ Google passed and check the index again.

Hope that help.

 

innozemec

Elite Member

Aug 19, 2011

5,404

1,815

• Jul 24, 2013

• #8

yeah, proxies are getting flagged faster when using index queries.

9k urls with only 10 proxies is really a bad idea. Try getting more proxies and increase the timeout between the queries

 

lalit_burma

Senior Member

Jan 30, 2010

856

581

• Aug 8, 2013

• #9

Even while checking 100 URLs with 20 proxies IP is showing blocked.

When we use same blocked IP for pr checking, its working fine.

There must be some reason for showing IP blocked in checking index and would love to know it in details along with the solution of it.

 

vjchere

Power Member

Jun 16, 2012

733

37

• Aug 8, 2013

• #10

You can ask your proxy company to change proxies. Most of the companies allow changing for once a month. You can also wait for 24 hour and proxies would be un banned.

 

lalit_burma

Senior Member

Jan 30, 2010

856

581

• Aug 8, 2013

• #11

vjchere said:

You can ask your proxy company to change proxies. Most of the companies allow changing for once a month. You can also wait for 24 hour and proxies would be un banned.

Click to expand...

That's ok we can do that ... but here is my question ... is scrapebox facing any kind of problem in checking index of website ?

There are many free tools which allow 25 index check on single but that one is also time consuming.

Any one here who represents scrapebox ?