Wants to learn bot creation and automation process

[opeyemidy]

Hello guys, i have been learning web development for quite some time now and l am familiar with Javascript and PHP programming languages. I want to learn bot creation. I'll like you guy's advice, recommendations and guide on how to proceed. Thanks

 

[aznxfrost]

What kind of bot are you trying to make?

 

[opeyemidy]

Bots can scrap data and manage social media accounts

 

[CryptMedia]

you can do that in JS with node or learn another language

 

[aznxfrost]

If you are familiar with Javascript, PHP and how websites GET POST AJAX etc, you can simply open up Chrome developer tools and start checking for network request/responses for the website you want to automate and try to emulate those requests inside PHP, however, you will see obstacles if the website requires captcha and stuff, in such case you need a real browser and inject your script into the browser for automation (Id recommend Electron, C# or Chrome Extension for this).

 

[blackdeviil]

Bots can scrap data and manage social media accounts

You can learn python for scraping and automation. And there are plenty of libraries in python which make the work easy for beginners.

 

[aznxfrost]

You can learn python for scraping and automation. And there are plenty of libraries in python which make the work easy for beginners.

This. You should always search Github for existing codes that could save you hours and days.

 

[opeyemidy]

you can do that in JS with node or learn another language

Yeah i'm already trying something out with node and puppeteer. What other nodejs tools can you recommend

 

[opeyemidy]

If you are familiar with Javascript, PHP and how websites GET POST AJAX etc, you can simply open up Chrome developer tools and start checking for network request/responses for the website you want to automate and try to emulate those requests inside PHP, however, you will see obstacles if the website requires captcha and stuff, in such case you need a real browser and inject your script into the browser for automation (Id recommend Electron, C# or Chrome Extension for this).

I'll check it out. Thanks

 

[johnkennedy20]

Python would be helpful in order to scrape the data. There are many packages available around to import them as per your requirement.

 

[Lamuks]

I mean you can do it with any language more or less. I made a scraper in C# when I needed it for a specific purpose.

My suggestion is : try to figure out what you want to make. A bot? A scraper? Choose a language, then check if there are any libraries that will help with that development. Rest is just google, youtub and stackoverflow.

 

[opeyemidy]

Alright thanks

 

[IvekIvek]

learn python for scraping and/or automating bot or you can use js for this (cheerio module)

 

[JackSparrowz]

Selenium at python would give you a great first impression of how great python can handle this.

 

[Cocinerito]

This. You should always search Github for existing codes that could save you hours and days.

As recommended above, Python is the ideal tool for automations.
I leave a link to GitHub of a bot that I made a long time ago to extract emails, I hope it helps you to learn.
https://github.com/DiegoCaraballo/Email-extractor

 

[opeyemidy]

Thanks I’ll check it out

 

[detriot]

I needed some instagram scrapping for a project and I learned a lot from stevesie. I would really recommend you to check stevesie.com as this guy has all the endpoints written out for you. He charges for his service but since ou are a programmer you could just copy all his endpoints and do it yourself.

 

[opeyemidy]

Alright. Thanks man

 

[darkblackdark]

try to simulate the web traffic of the web applicationt hat you are targeting. a local proxy like burp could be useful to learn about its behaviour from technical perspective. Easier choice would be smth like selenium webdrivers with python bindings

 

[Tortor33]

you can start with selenium