I have just made a bot that gets a proxy, opens my adf,ly link with chrome and clicks on the skip ad button after a couple of seconds. It was working totally fine in the beginning, but after likr 10 hours my account got suspended. I tried with different proxies, but i got banned once again after the same period of time. What I need to know is how to make the webdriver and selenium undetectable. Does anyone have a solution?
[PYTHON] How to make webdriver with selenium undetectable?
- Thread starter paraflax
- Start date
michiosha1
Junior Member
- Mar 26, 2019
- 129
- 40
First of all problem is not with automation tools detection, cos it would block you instantly instead of after 10h.
Anyway, you didn't tell with what driver you have that problem (fireforx, chrome etc), for selenium you may be required to compile custom driver without f.e. _cdc fields and also after that you'd have to set webdriver to empty object.
Selenium is great for what it's done - websites testing with various browsers having one api. However for writing bots/scrappers there are tools that will make hiding easier. You have example with puppeteer here: https://intoli.com/blog/not-possible-to-block-chrome-headless/
Anyway, you didn't tell with what driver you have that problem (fireforx, chrome etc), for selenium you may be required to compile custom driver without f.e. _cdc fields and also after that you'd have to set webdriver to empty object.
Selenium is great for what it's done - websites testing with various browsers having one api. However for writing bots/scrappers there are tools that will make hiding easier. You have example with puppeteer here: https://intoli.com/blog/not-possible-to-block-chrome-headless/
I will try this. I don’t really know where to start, but i hope that I will be able to solve it. I’m using Chrome btw. Thank you!
CanonStriker
Newbie
- Nov 5, 2018
- 32
- 10
I am interested in knowing how to properly do this, I am a Python noob that wants to learn things like this.
michiosha1
Junior Member
- Mar 26, 2019
- 129
- 40
Do what? Because if you are talking about 'making selenium undetectable' you have nice info in the link that I shared, however it's for puppeteer so you'd need to use javascript instead of python.
TemaDol
Newbie
- May 16, 2020
- 45
- 5
I spent a lot of time trying to figure out how to make myself anonymous using selenium
try to random NOT BLOCK your Agent, your Fingerprints , your plattform , your ip and your cookies ,Adblock ,browser language and header requests ,System Fonts and Screen Size and Color Depth.as far as I can currently remember
try to random NOT BLOCK your Agent, your Fingerprints , your plattform , your ip and your cookies ,Adblock ,browser language and header requests ,System Fonts and Screen Size and Color Depth.as far as I can currently remember
donsilnobl
Registered Member
- Nov 20, 2014
- 53
- 9
Turn off webrtc and use proxy. Avoid headless browser for the beginning.
You have to look like normal user. I mean your bot should behave like trusted user.
1. Avoid to use freshly registered accounts (you can by accounts with some history)
2. When you code your bot always remember you' pretend to be a human. Human DO NOT navigate in DOM tree, he is dragging mouse all over a screen, clicking, reading etc with different timings and periods. Try to find tracking heat maps and you shell see how normal human acts with internet pages.
3. Give a rest to your "human" from time to time and don't forget real humans has a rest, launch and working hours, it's damn easy to understand that this is a bot if it's works as a hell 10 hours. Make your own time patterns for every instance according their timezone.
4. DON NOT use shaddy low quality proxy from the public like ip v 6 and tor - buy normal according your google account location.
5. DO NOT try to exchange your headers on very fake like you have real user-agent but in headers you pass very different, it's easy to check your real engine and get what you're trying to scam.
Try more, it's very difficult task but it's still possible.
1. Avoid to use freshly registered accounts (you can by accounts with some history)
2. When you code your bot always remember you' pretend to be a human. Human DO NOT navigate in DOM tree, he is dragging mouse all over a screen, clicking, reading etc with different timings and periods. Try to find tracking heat maps and you shell see how normal human acts with internet pages.
3. Give a rest to your "human" from time to time and don't forget real humans has a rest, launch and working hours, it's damn easy to understand that this is a bot if it's works as a hell 10 hours. Make your own time patterns for every instance according their timezone.
4. DON NOT use shaddy low quality proxy from the public like ip v 6 and tor - buy normal according your google account location.
5. DO NOT try to exchange your headers on very fake like you have real user-agent but in headers you pass very different, it's easy to check your real engine and get what you're trying to scam.
Try more, it's very difficult task but it's still possible.
XVSound
Newbie
- Dec 30, 2019
- 14
- 11
How exactly do you do this? Setting Webdriver to empty?
WeedandEat
Newbie
- Dec 25, 2021
- 13
- 15
For my projects I used a diffrent version of the chromedriver which bypasses some bot-detections.
https://pypi.org/project/undetected-chromedriver/2.1.1/
You could also use a fake user agent generator for example this package
https://pypi.org/project/fake-useragent/
Using rotating proxies which change their IP after one link click might be the best for your problem but I don't know if its any profitable
You should also randomize the behaviour your script has to lower the chances of getting banned.
https://pypi.org/project/undetected-chromedriver/2.1.1/
You could also use a fake user agent generator for example this package
https://pypi.org/project/fake-useragent/
Using rotating proxies which change their IP after one link click might be the best for your problem but I don't know if its any profitable
You should also randomize the behaviour your script has to lower the chances of getting banned.
RobJ
Newbie
- Jan 21, 2022
- 3
- 0
Concern about your fingerprint, you can check https://amiunique.org/fp, i'm not sure if you'll be undetectable but probably more hide and safe against tracks.
Thing like, screen-resolution, user-agent, browser, Platform etc... can make a big impact in systems detect you.
Obs.: Remember each profile/identity need your unique fingerprint different from others.
Thing like, screen-resolution, user-agent, browser, Platform etc... can make a big impact in systems detect you.
Obs.: Remember each profile/identity need your unique fingerprint different from others.
brucebanner
Junior Member
- Jan 29, 2022
- 192
- 64
by "you'd have to set webdriver to empty object" what you mean? If webdriver is null logically it wont even start??? can you specify your thought?
thx
Hi, I am trying to do the same but with different shortener. May I know where do you get free proxies? Because The proxies that I am always getting is VERY SLOW, it takes 10-20 seconds to load a webpage. And How many free unique proxies are available for you in a day? Thanks.
I pay for a subscription of a desktop Vpn and auto turn off and on it using pywinauto, a python library. It chooses the array of servers and checks if The IP is unique, if unique, then click the server and connect to it. But I would like to switch to proxies as I can integrate it easily with python without pywinauto. May I know if you encounter any problems in using free proxies? Bevause when i scraped free proxies, the webpage loads very slow. May I also know where do you get free decent proxies? Thanks
brucebanner
Junior Member
- Jan 29, 2022
- 192
- 64
free proxies is the worst thing as its used by millions of persons
- Mar 22, 2013
- 9,139
- 10,489
Man, adf ly? Come on man...
If you have the brain for this seleniun automation stuff, youre gonna waste your time on adf ly? Oh man oh man...
If you have the brain for this seleniun automation stuff, youre gonna waste your time on adf ly? Oh man oh man...
do you have any suggestions on how to monetize our "selenium automation stuff" skills?
- Mar 22, 2013
- 9,139
- 10,489
I do not. But trying to game adf ly for cents is just... Just find something else.
Plus adf ly isnt stupid. Im sure they have their bot-detection crap or whatever exactly to stop you from doing what you wanna do.
And in the end, lets say you succeed. Are you going to scale? Great youll scale from $0.50/day to $5/day lol
And then when you get to $5/day, theyll not pay you, and then ban you.
I believe, and i could be wrong, that when your idea here is all said and done all youll have left is whatever knowledge you obtain in selenium and trying to do all of this. But you wont have any money in your hands.
I wish i could suggest something you could do, but i cant. You gotta figure that out on your own. Or maybe somebody else has some suggestions
Alexion
Banned - Shitlisted and did not do the right thing
- Sep 9, 2021
- 1,456
- 3,803
Microworkers. Automate all the reddit upvote jobs. Easy $1-$2/day.