ASK me anything about python

SeasonedCode said:
I see the best solution here is to reverse engineering the mobile APP
look at API endpoints and send requests to them
Click to expand...
Reversing mobile API of site like Instagram is a huge project to complete. Even if you work in the team it can take a lot of time. Instagram also do changes to the api frequently to find the bots. Meaning one day they can make a small change, that doesn't affect anyone, but your bots and you basically lose close to everything. I would suggest going for mobile automation directly if you don't want to play too much of cat and mouse game.
 
Advertise on BHW
Hello

we are looking for assistance in developing a Selenium script that will automate the Gmail account creation process.

Our approach includes using SMS-Activate or manual SIM cards for SMS verification, local 4G IPs, and Dolphin Anty to avoid browser detections. We have come across a GitHub repository (https://github.com/ai-to-ai/Auto-Gmail-Creator), but we are unsure of its current functionality.

We would greatly appreciate any technical guidance, suggestions, If you have expertise in Selenium scripting or related areas, please reach out!

Thank you for your support and collaboration.
 
Black_Adam said:
Selennium Vs Puppeteer Vs Playwright ?
Click to expand...
Selenium and puppeteer are good
But to choose one it depends on the project
If you need simple and small scripts that automate accounts creation for example
I would choose Selenium

If you want more capabilities especially with the new headless feature I would choose puppeteer
 
OK here's another question. I know both Python and JavaScript and its associated frameworks. In your opinion which path is the most rewarding to invest my time in, in terms of money making opportunities (primarily via freelancing) ?. In the Python skill-tree I see myself specializing in data science/ML. Problem is that ML/DS roles are not really entry-level. In the JS ecosystem its the usual web dev/full stack etc. Kind of confused tbh as both paths would require a significant time investment.
 
Black_Adam said:
OK here's another question. I know both Python and JavaScript and its associated frameworks. In your opinion which path is the most rewarding to invest my time in, in terms of money making opportunities (primarily via freelancing) ?. In the Python skill-tree I see myself specializing in data science/ML. Problem is that ML/DS roles are not really entry-level. In the JS ecosystem its the usual web dev/full stack etc. Kind of confused tbh as both paths would require a significant time investment.
Click to expand...
It depends on what you love
If you wanna follow freelancing path you can scrape and offer data to small or big companies
Me I almost daily getting offers to scrape data
You can learn reverse engineering and start building your own automation SaaS
Cause at the end browsers automation isn't that scalable you need to use request directly to server and get the data back in json and to do this you need to have a deep understanding about firewalls bot detection systems and API security
If you see everything is not easy but the thing is to learn what you love and not what brings more money
For example me I have make my first doller from my codding skills after almost one year
Say if I wasn't love this field I would give up in my first or second month cause I see no money
I hope you understand my idea
And good luck :)
 
Is worth it to create social media bots trough mobile api? Whats the best platform in terms of monetization/effort
Describe your experience and things to consider.
Also, any do you had any issue with the app certificate pinning for mimic the app behavior by requests?
 
SeasonedCode said:
It depends on what you love
If you wanna follow freelancing path you can scrape and offer data to small or big companies
Me I almost daily getting offers to scrape data
You can learn reverse engineering and start building your own automation SaaS
Cause at the end browsers automation isn't that scalable you need to use request directly to server and get the data back in json and to do this you need to have a deep understanding about firewalls bot detection systems and API security
If you see everything is not easy but the thing is to learn what you love and not what brings more money
For example me I have make my first doller from my codding skills after almost one year
Say if I wasn't love this field I would give up in my first or second month cause I see no money
I hope you understand my idea
And good luck :)
Click to expand...
Thanks for the info. I got started down the web scraping path but hit a roadblock around the bot detection and security features. And most of the tutorials either offer incomplete solutions or sell their SaaS API or custom solution (which is expensive). I love the field but seems like there is a lot of gatekeeping and hiding of info around it. Nobody gives straight answers to common web scraping problems, especially the ones dealing with bypassing bot detection. Would appreciate a few pointers since you seem to be an expert.
 
Black_Adam said:
Thanks for the info. I got started down the web scraping path but hit a roadblock around the bot detection and security features. And most of the tutorials either offer incomplete solutions or sell their SaaS API or custom solution (which is expensive). I love the field but seems like there is a lot of gatekeeping and hiding of info around it. Nobody gives straight answers to common web scraping problems, especially the ones dealing with bypassing bot detection. Would appreciate a few pointers since you seem to be an expert.
Click to expand...
Actually this is true most people won't tell there secrets but I wanna guarantee that most of those youtubers never made any bot they are full time youtubers and a few of them actually developers
For me I got my experience by trying and failing as this field change really quickly and it is like the mouse and cat
Bot creators discover a new way to bypass detection then the detector creators create another solution
The thing is to have a deep understanding about how the data actually get transferred around the Web
To make it easier for you
You need to know
http
tls
tcp
Those two protocols (http and tcp) have a rules based on those rules bot detection systems detect bots and humans
If you understand them deeply you will be able to create your own bypass
Lastly I wanna tell you that to learn those protocols it isn't a walk in park they are super hard to understand especially when you get to that low level implementation
The thing is to give yourself time to learn try and fail till you be proud of yourself

Good luck
 
SeasonedCode said:
Actually this is true most people won't tell there secrets but I wanna guarantee that most of those youtubers never made any bot they are full time youtubers and a few of them actually developers
For me I got my experience by trying and failing as this field change really quickly and it is like the mouse and cat
Bot creators discover a new way to bypass detection then the detector creators create another solution
The thing is to have a deep understanding about how the data actually get transferred around the Web
To make it easier for you
You need to know
http
tls
tcp
Those two protocols (http and tcp) have a rules based on those rules bot detection systems detect bots and humans
If you understand them deeply you will be able to create your own bypass
Lastly I wanna tell you that to learn those protocols it isn't a walk in park they are super hard to understand especially when you get to that low level implementation
The thing is to give yourself time to learn try and fail till you be proud of yourself

Good luck
Click to expand...
Hello,

Having worked as a cybersecurity consultant, I have a solid understanding of how TCP (Transmission Control Protocol), TLS (Transport Layer Security), and HTTPS (Hypertext Transfer Protocol Secure) operate. If you have any questions or if there's a concept you'd like me to break down, feel free to ask.

As we navigate the ever-evolving landscape of social media, I find myself contemplating the future of bot and automation detection.
I'd love to hear your thoughts and engage in a discussion about the challenges and opportunities that lie ahead.

One of the fascinating aspects of cybersecurity is the role of AI and machine learning in both the creation of sophisticated bots/automation and their subsequent detection.

In this context, understanding the importance of randomness and simulating human behavior is paramount.
 
What is the best backend framework on Python next to Django? In your opinion
 
SeasonedCode said:
hello everyone
as in the title ask me anything you want about python especially scrapping and automation
Click to expand...
How to create article creator automation for wordpress using openai? can you help with it? like where to start or amything
 
What is the best python+browser combo for scraping cloudflare protected dynamic (JavaScript) websites using headless browser (playwright, selenium,etc) in Ubuntu VPS? (Key point is to bypass CF captcha)
 
BP247 said:
What is the best python+browser combo for scraping cloudflare protected dynamic (JavaScript) websites using headless browser (playwright, selenium,etc) in Ubuntu VPS? (Key point is to bypass CF captcha)
Click to expand...
1. don’t use firefox, use something chromium-based
2. install Privacy Pass ext and make your bot solve some captcha challenges to get points/cookies beforehand (before you actually start scraping CF protected website)
4. use good virgin residential IPs
5. pray :)
 
jamb0ss said:
1. don’t use firefox, use something chromium-based
2. install Privacy Pass ext and make your bot solve some captcha challenges to get points/cookies beforehand (before you actually start scraping CF protected website)
4. use good virgin residential IPs
5. pray :)
Click to expand...
As mentioned, I'm using it on my VPS therefore can't use residential IPs (I think)

Which chromium based browser do you suggest?
Two person said selenium base and one suggested chromedriver

When my python script is executed it opens clean instance of chrome without any extensions, though I have extensions in my browser but script doesn't load them. How can I use privacy pass ext in that case?

Please guide me.
 
BP247 said:
As mentioned, I'm using it on my VPS therefore can't use residential IPs (I think)
Click to expand...
why not? just use proxy (browser settings) or even better VPN (to prevent DNS leaks etc)

BP247 said:
Which chromium based browser do you suggest?
Two person said selenium base and one suggested
Click to expand...
selenium can be used with different browsers (chrome, firefox etc), it’s just a driver
BP247 said:
How can I use privacy pass ext in that case?
Click to expand...
it depends on how you interact with your browser, chromium-based browsers dont’t support extensions in headless mode as far as I remember, so I used virtual display to run it on my server
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top