Proxies for web scraping

B

blackscrapy

Newbie
Joined
Oct 30, 2014
Messages
41
Reaction score
5
Hello

I am in the lookout for some reliable shared proxies that would be used for web scraping.

Kindly suggest from where I can get these proxies


Thanks
 
Advertise on BHW
Anyone?

Also please advise whether shared or dedicated (private) would be better for web scraping?
 
Hei, SpamBotKing here.
Sadly, I cannot give to you any info about where buy proxy (I use a private seller right now) but I think any proxy vendors will be fine.

* If I have time, and the scraping process is NOT confidential (example: scan a craiglist like website etc.) I go with public proxy. I scrape them, check them, keep the most quicks, and then go. Not an elegant way, but it works.
* If I need to scrape a HUGE amounts of page of a website and I have time, I go with shared
* If I have to maximize my operations, I will use private proxies.
 
Depends on what sites your scraping. Google best with private, some random site you might not need any.
 
For scraping I would use proxies that come with ports. It changes proxies every 10 minutes.

So technically you can use 100s of proxies without the fear of getting them banned on google.
 
Thanks for your replies guys. I would be using these proxies mainly for scraping YellowPages (US/AU) I tried some shared proxies but they were too slow. I signed up for Reverse Port proxies, but the vendor never responded, so I canceled.

I am looking for a provider who provides quality proxies (anonymous) at reasonable prices and offer great support.

Any suggestions?
 
blackscrapy said:
Thanks for your replies guys. I would be using these proxies mainly for scraping YellowPages (US/AU) I tried some shared proxies but they were too slow. I signed up for Reverse Port proxies, but the vendor never responded, so I canceled.

I am looking for a provider who provides quality proxies (anonymous) at reasonable prices and offer great support.

Any suggestions?
Click to expand...

We're offering our US Private proxies for web Scraping :)
but which web Scraping sites you want ? and which tool
you using ?you can check on our signature with dedicated
Skype - email Customers Support
 
ShaNi said:
We're offering our US Private proxies for web Scraping :)
but which web Scraping sites you want ? and which tool
you using ?you can check on our signature with dedicated
Skype - email Customers Support
Click to expand...

Hi Shani

Thanks for your message

As I said, I primarily am looking to scrape YellowPages (US & AU) with it and some other sites as and when needed.

The scraping tools are custom made in house with C#

Can I get a review copy to test out your proxies first?


Thanks
 
blackscrapy said:
Hi Shani

Thanks for your message

As I said, I primarily am looking to scrape YellowPages (US & AU) with it and some other sites as and when needed.

The scraping tools are custom made in house with C#

Can I get a review copy to test out your proxies first?


Thanks
Click to expand...
then its work but where you using your tool on normal DSL Speed
or VPS = Dedicated Server ? sorry no trial proxies :) Private proxies
must be work
 
ShaNi said:
then its work but where you using your tool on normal DSL Speed
or VPS = Dedicaterr Server ? sorry no trial proxies :) Private proxies
must be work
Click to expand...

I run them mostly from my desktop with a 1Mbps cable internet connection.
 
You using low DSL Speed for Scraping mate . your fist method is wrong
Scraping means Power . You need nice VPS or Dedicated Server machine
with 1GB port link Speed . if you using low DSL Speed then you can't see
nice results on any types of Proxies

always use all SEO customs tools or famous Scraping tools on nice Vps
or Dedicated Server machine's then you will See awesome results ;)
if you Scraping normal just few 100s results then your 1MB is just okay
but still not good
 
@blackscrapy:

I much experienced on web scraping from search engines if you still want some tips on proxies where to get and how to use and what are major steps to take to get done.

Let me know :)

Thanks!
 
extremeboy said:
I much experienced on web scraping from search engines if you still want some tips on proxies where to get and how to use and what are major steps to take to get done.

Let me know :)

Thanks!
Click to expand...


That would be great extremeboy

Please suggest on the best possible tools, proxies and practices for web scraping.

I don't scrape too much of Google, but mainly sites like YellowPages, YellowBot etc

Your valuable advice is solicited :)


Thanks !
 
I use buyproxies org for my gsa ser, scrapebox and kontent machine activities
 
blackscrapy said:
That would be great extremeboy

Please suggest on the best possible tools, proxies and practices for web scraping.

I don't scrape too much of Google, but mainly sites like YellowPages, YellowBot etc

Your valuable advice is solicited :)


Thanks !
Click to expand...


Add me on skype then i can give my advice for you according to your resources you have thanks :)
 
HMA updates their public proxy list every minute with 7-10 new entries, that should be more that enough. I've used them quite a bit and I haven't run on any issues.
If you have trouble scraping proxy list from HMA website, let me know, I could probably help you.

Good luck.
 
The proxies I am currently using are good but they don't allow connections via ports 2082, 2083 and 25

Does anyone know of a proxy dealer who doesn't block the above ports?
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top