Any scraper/bot ideas?

[thirdTicket]

Hi,

I have built some scrapers and bots in the past, and I'm looking for a meaningful way to intergrate them in some sort of a method or a strategy. Does anyone have some good ideas how to turn these skills into a successfull strategy?
Let's discuss.

 

[Roger Marquez]

How about massively scraping articles from expiring domains from the web archive? Or do you have something similar already build for this?

 

[Brain_Drain]

Lots of people still searching bots for browser games .

Automation in browser games is the key. The less a player does to evolve, the higher the value of the bot.

The hardest part is not being recognized by the anti-bot software the have.

 

[corameleviv]

How about massively scraping articles from expiring domains from the web archive? Or do you have something similar already build for this?

Good idea how can earn after scraping

 

[corameleviv]

Lots of people still searching bots for browser games .

Automation in browser games is the key. The less a player does to evolve, the higher the value of the bot.

The hardest part is not being recognized by the anti-bot software the have.

How can earn money in botting gaming i can create bot also but how use in gaming domain

 

[Brain_Drain]

How can earn money in botting gaming i can create bot also but how use in gaming domain

Well, the simple answer is to sell it.
I'm playing a browser game for about 10 years and "free" bots come and go but everyone is getting banned cause it's not easy to trick their software.
The key is to make your bot look like an actual player and simulate as best as you can a player's behavior.

Puppeteer helped me a lot with this. It actually opens a browser, so you can code it to do anything someone would do to visit a website/game

 

[corameleviv]

Well, the simple answer is to sell it.
I'm playing a browser game for about 10 years and "free" bots come and go but everyone is getting banned cause it's not easy to trick their software.
The key is to make your bot look like an actual player and simulate as best as you can a player's behavior.

Puppeteer helped me a lot with this. It actually opens a browser, so you can code it to do anything someone would do to visit a website/game

Thank you for explanation ... I can make bot with human behavor and bypass all spam filter ... Should i found someo'e with good knowledge in this domaine and maybe working together

 

[Grudge]

Well, the simple answer is to sell it.
I'm playing a browser game for about 10 years and "free" bots come and go but everyone is getting banned cause it's not easy to trick their software.
The key is to make your bot look like an actual player and simulate as best as you can a player's behavior.

Puppeteer helped me a lot with this. It actually opens a browser, so you can code it to do anything someone would do to visit a website/game

What game is it and for how much do these bots go for?

 

[Brain_Drain]

What game is it

I'm talking about Grepolis.

and for how much do these bots go for?

Depends on the bot. Others last for days, others for weeks, some are still around for basic tasks.
It's all about causing "unusual traffic" from a certain IP. Some made lots of unnecessary http requests so it was easy to detect

 

[Brain_Drain]

Thank you for explanation ... I can make bot with human behavor and bypass all spam filter ... Should i found someo'e with good knowledge in this domaine and maybe working together

If you are going to use Puppeteer, I suggest to setup a project and begin with simple tasks, like browsing around websites, type something in google a move the cursor to the "search" button. Just to get around with it

 

[ReverseAndCode]

I have built some scrapers and bots in the past, and I'm looking for a meaningful way to intergrate them in some sort of a method or a strategy. Does anyone have some good ideas how to turn these skills into a successfull strategy?

I'm a big fan of the combination: social media app (without a website) -> scrape active users -> scrape friends of those users -> add/follow all found users/friends -> monetize

 

[corameleviv]

If you are going to use Puppeteer, I suggest to setup a project and begin with simple tasks, like browsing around websites, type something in google a move the cursor to the "search" button. Just to get around with it

Selenium...i have big experience in automation world

 

[Roger Marquez]

Good idea how can earn after scraping

1. Do you think the writing services being offered here on BHW charging pennies for a 500-word article are actually written? Fiverr is filled with these types of gigs. You can resell those articles on the market
2. You can use those articles to build web 2.0 properties and build links to your money site.

 

[soralmabor2]

I would scrap targeted contacts from every social network I could. Then contact them with relevant offers.

 

[ReverseAndCode]

I would scrap targeted contacts from every social network I could. Then contact them with relevant offers.

That's basically what I wrote above and explained with a workflow already. ;-)

 

[soralmabor2]

That's basically what I wrote above and explained with a workflow already. ;-)

Exact ! But I wouldnt limits myself to DM, you can extract emails as well for example

 

[ReverseAndCode]

Exact ! But I wouldnt limits myself to DM, you can extract emails as well for example

The apps of large social networks like Instagram, Snapchat, TikTok - maybe also Badoo, Bumble, Hingle, Lovoo, Tinder - don't allow you to extract email addresses. The JSON responses don't contain this field.

Except the users wrote their email addresses into the public profile (bio). But that's like how many percent? I guess maximum 0,001 %? ;-)

Of course if there are bots behind the social media profiles you're going to scrape, they contain links to other networks or landing pages. But who would like to address bots?

 

[soralmabor2]

The apps of large social networks like Instagram, Snapchat, TikTok - maybe also Badoo, Bumble, Hingle, Lovoo, Tinder - don't allow you to extract email addresses. The JSON responses don't contain this field.

Except the users wrote their email addresses into the public profile (bio). But that's like how many percent? I guess maximum 0,001 %? ;-)

Of course if there are bots behind the social media profiles you're going to scrape, they contain links to other networks or landing pages. But who would like to address bots?

You are completly wrong my friend. Scrappers are able to scrap such informations. I do it for Instagram already

 

[ReverseAndCode]

You are completly wrong my friend. Scrappers are able to scrap such informations. I do it for Instagram already

I'm highly interested to see screenshots about TikTok, Snapchat, ... - Badoo, Bumble, Hinge, Lovoo, Tinder - revealing 100 % of the email addresses of their users.

And please, we don't talk about professional accounts or bot made accounts:

Except the users wrote their email addresses into the public profile (bio). But that's like how many percent? I guess maximum 0,001 %? ;-)

Of course if there are bots behind the social media profiles you're going to scrape, they contain links to other networks or landing pages. But who would like to address bots?

But maybe I misunderstood you previously, because I thought you were talking about "scraping/scrapers". ;-)


Edit: Extended with my own quote

 

[soralmabor2]

I'm highly interested to see screenshots about TikTok, Snapchat, ... - Badoo, Bumble, Hinge, Lovoo, Tinder - revealing 100 % of the email addresses of their users.

And please, we don't talk about professional accounts or bot made accounts:



But maybe I misunderstood you previously, because I thought you were talking about "scraping/scrapers". ;-)

You are right, these cannot be scrapped.