Hello Everyone!

salamd06

Newbie

Mar 12, 2025

6

3

• Mar 12, 2025

• #1

I wanted to reach out and say hello. I have a friend who has learned a lot here and wanted to join.

I am currently working on a webscraping app in python. I'm getting case data from the MN judicial.gov website. I have gotten to the point where it grabs the data I need, but I get blocked after pulling more than two records. Im looking into incorporating proxies to prevent this block. Has you done something similar and have you had luck with proxies? Any recommendations?

 

Digital Delights

Junior Member

Aug 23, 2023

106

25

• Mar 12, 2025

• #2

first of all welcome to BHW . Use rotating residential proxies, implement request delays, and rotate user agents to prevent getting blocked while scraping the MN judicial.gov website

 

V

Elite Member

Jr. Executive VIP

Jr. VIP

May 18, 2012

7,630

7,493

• Mar 12, 2025

• #3

Welcome to BHW, mate.

Digital Delights said:

Use rotating residential proxies, implement request delays, and rotate user agents to prevent getting blocked while scraping the MN judicial.gov website

Click to expand...

Give this a try. It should work, provided the site doesn't have overly strict policies.

 

back2form

Elite Member

Jul 15, 2012

6,931

10,467

• Mar 12, 2025

• #4

Welcome to Blackhatworld Forum..

Thank your friend who shown this platform,
As like he learned, Hope you will learn a lot too.

All the best

 

Shakeelahmed21

Regular Member

Jr. VIP

Jun 30, 2024

450

56

• Mar 12, 2025

• #5

Welcome to BHW! Hope you find great success here.

 

proxygo

Elite Member

Executive VIP

Jr. VIP

Nov 2, 2008

59,085

26,608

• Mar 12, 2025

• #6

i guess people still dont follow the rules

Member responding to an intro thread:
Responses of more than 5 words

 

B

backlinks_seo

Newbie

Mar 11, 2025

28

9

• Mar 12, 2025

• #7

Yes, proxies can help, but you should rotate them and use residential or high-quality datacenter proxies to avoid detection. Also, try adding delays and randomizing requests. Have you considered using services like ScraperAPI or Bright Data?

 

projectlegents

Regular Member

Jr. VIP

Oct 21, 2017

474

319

• Mar 13, 2025

• #8

Hey, Welcome to BHW forum. Kindly make your post on proxies sub forum and get help.

 

Layout

BANNED

Oct 13, 2014

81

22

• Mar 13, 2025

• #9

Hello salamd06, welcome to BlackHatWorld!


We're glad to have you here. This forum is full of valuable insights and experienced members, so feel free to explore, ask questions, and contribute. If you ever need guidance, don't hesitate to reach out.


Wishing you success on your journey!

 

S

saferidge

Senior Member

Jr. VIP

Jan 8, 2025

1,072

395

• Mar 14, 2025

• #10

Welcome to BHW!
Sounds like the site has some solid bot detection. Switching IPs too fast might be tripping their system. You might want to use tools for automating web browsing. They basically let you interact like a real user, which can help avoid getting blocked.

 

G

Gennaro Steubersteuber

Junior Member

May 3, 2024

124

40

• Mar 14, 2025

• #11

Welcome to BHW forums my friend!

 

Undisputedads

Registered Member

Feb 28, 2025

77

34

• Mar 14, 2025

• #12

hello there and welcome to the BlackHatWorld Forums, I hope you find a solution to your request blocking issue here

 

Larissa Audrey

Newbie

Mar 14, 2025

29

26

• Mar 14, 2025

• #13

salamd06 said:

I wanted to reach out and say hello. I have a friend who has learned a lot here and wanted to join.

I am currently working on a webscraping app in python. I'm getting case data from the MN judicial.gov website. I have gotten to the point where it grabs the data I need, but I get blocked after pulling more than two records. Im looking into incorporating proxies to prevent this block. Has you done something similar and have you had luck with proxies? Any recommendations?

Click to expand...

Hello & Welcome to the BHW forum