PROXIES FOR SCRAPING
- Thread starter Troyston
- Start date
- May 29, 2018
- 6,337
- 7,054
Mobile proxies are best since the social networks are looking for that
- Feb 18, 2025
- 1,914
- 444
Mobile Proxies; Specifically, 4g or 5g proxies. There are many threads that can show you how you can make your own. Just go through the threads and you can find how to make those
godssolder
Junior Member
- Jun 1, 2013
- 127
- 81
Datacenter proxies are known for their high speed and cost-effectiveness, making them suitable for scraping less protected websites; however, they are more easily detected and blocked due to their association with data centers. Residential proxies offer IP addresses assigned by Internet Service Providers to real users, providing higher anonymity and making them ideal for scraping sites with strict anti-bot measures, though they tend to be more expensive and potentially slower. Mobile proxies, which route traffic through mobile networks, offer the highest level of trust and are effective against sophisticated anti-bot systems, but they come at a higher cost and may have limited bandwidth. ISP (static residential) proxies combine the benefits of residential IPs with the reliability of datacenter infrastructure, offering a balance between speed and trustworthiness. If you're starting out or working on a budget, datacenter proxies might be sufficient, but for more complex or large-scale scraping tasks, investing in residential or ISP proxies could yield better results.
Scraping does not include proxy usage,can scrape with your primary residential ip but proxies are only used for tools/bot
- Dec 17, 2024
- 775
- 171
It heavily depends on your needs and target website.
Please share more details to get a good answer.
tompots
Elite Member
- Dec 11, 2011
- 5,775
- 4,871
Residential work best for Instagram scraping because of low flag risk, but they’re pricier. 4G mobile proxies.
BalticProxy_Eu
Senior Member
- Mar 8, 2018
- 1,025
- 481
Mobile proxies are the best since its harder to detect and auto rotates. It's really suitable for social media.
- Feb 4, 2012
- 1,892
- 91
You can use Residential proxies and Mobile proxies. Although, I found mobile proxies to be more expensive.
- Nov 2, 2008
- 59,085
- 26,608
im assuming your post is for scraping instagram ?
hamzapro1245
BANNED
- Jan 11, 2025
- 67
- 26
The best proxies for scraping are residential, data center, and rotating proxies. Residential proxies are ideal for avoiding blocks because they use real IP addresses, though they are slower and more expensive. Data center proxies are cheaper and faster but easier for websites to detect and block. Rotating proxies automatically change IPs, providing better anonymity and avoiding detection, but they can be less stable and more costly. The choice depends on your needs—residential for reliability, data center for speed, and rotating for large-scale, low-detection scraping.
Alfon
Regular Member
- Jan 6, 2013
- 450
- 249
I'm building systems for my business that require scraping Instagram or other social media platforms. If your volume isn't super high and you don't need to do excessive parallel/concurrent work, what worked for me was taking my beloved Raspberry Pi out of the drawer, installing Ubuntu without a desktop environment, and then installing Tailscale and marking my Raspberry Pi as an exit node. Now, I have a high-quality residential proxy that I can connect to from anywhere.
After that, you can deploy remote workers (scrapers) on Linux servers that can leverage TailScale VPN to use your home public IP address.
It's fun, cheap (free is you don't count RPi purchase and electricity cost), and reliable. I've experienced zero blocks so far; I'm scraping mostly feed activity and the latest posts from target users.
After that, you can deploy remote workers (scrapers) on Linux servers that can leverage TailScale VPN to use your home public IP address.
It's fun, cheap (free is you don't count RPi purchase and electricity cost), and reliable. I've experienced zero blocks so far; I'm scraping mostly feed activity and the latest posts from target users.
Ori Ori
Newbie
- Mar 26, 2025
- 25
- 9
Mobile proxies (4G or 5G) are still the leader in proxies. Try them out.
- Aug 24, 2020
- 5,128
- 1,662
Typically mobile proxies would be your go to for scraping bigger platforms or just platforms sensitive to automation in general. Because the IPs rotate through real carrier IPs, they get treated as legitimate user traffic and bypass a lot of the basic bot detection just on the face of it. Pricey though, typically slower in terms of speed too (usually the top complaints you get from them).
Residential proxies are on the affordable side and works well for just lower-scale scraping or platforms that aren't too aggressive with bots. You still have to tip-toe with the volume and frequency though or you run the risk of burning through the IPs fast.
Datacenter and VPN I normally lump together for these things since they're on-sight with most platforms for anything more than casually browsing region specific content. Although for VPNs I know a few sites that don't give you access at all (super niche but really good dating sites mostly).
Residential proxies are on the affordable side and works well for just lower-scale scraping or platforms that aren't too aggressive with bots. You still have to tip-toe with the volume and frequency though or you run the risk of burning through the IPs fast.
Datacenter and VPN I normally lump together for these things since they're on-sight with most platforms for anything more than casually browsing region specific content. Although for VPNs I know a few sites that don't give you access at all (super niche but really good dating sites mostly).
NyronProxies
Regular Member
- Mar 25, 2025
- 208
- 19
Hello, we can help you if you want. Just send a PM.