Any scraper/bot ideas?

thirdTicket · Dec 28, 2020

Hi,

I have built some scrapers and bots in the past, and I'm looking for a meaningful way to intergrate them in some sort of a method or a strategy. Does anyone have some good ideas how to turn these skills into a successfull strategy?
Let's discuss.

Roger Marquez · Dec 28, 2020

How about massively scraping articles from expiring domains from the web archive? Or do you have something similar already build for this?

Brain_Drain · Dec 29, 2020

Lots of people still searching bots for browser games .

Automation in browser games is the key. The less a player does to evolve, the higher the value of the bot.

The hardest part is not being recognized by the anti-bot software the have.

corameleviv · Dec 29, 2020

Roger Marquez said:
How about massively scraping articles from expiring domains from the web archive? Or do you have something similar already build for this?

Good idea how can earn after scraping

corameleviv · Dec 29, 2020

Brain_Drain said:
Lots of people still searching bots for browser games .

Automation in browser games is the key. The less a player does to evolve, the higher the value of the bot.

The hardest part is not being recognized by the anti-bot software the have.

How can earn money in botting gaming i can create bot also but how use in gaming domain

Brain_Drain · Dec 29, 2020

corameleviv said:
How can earn money in botting gaming i can create bot also but how use in gaming domain

Well, the simple answer is to sell it.
I'm playing a browser game for about 10 years and "free" bots come and go but everyone is getting banned cause it's not easy to trick their software.
The key is to make your bot look like an actual player and simulate as best as you can a player's behavior.

Puppeteer helped me a lot with this. It actually opens a browser, so you can code it to do anything someone would do to visit a website/game

corameleviv · Dec 29, 2020

Brain_Drain said:
Well, the simple answer is to sell it.
I'm playing a browser game for about 10 years and "free" bots come and go but everyone is getting banned cause it's not easy to trick their software.
The key is to make your bot look like an actual player and simulate as best as you can a player's behavior.

Puppeteer helped me a lot with this. It actually opens a browser, so you can code it to do anything someone would do to visit a website/game

Thank you for explanation ... I can make bot with human behavor and bypass all spam filter ... Should i found someo'e with good knowledge in this domaine and maybe working together

Grudge · Dec 29, 2020

Brain_Drain said:
Well, the simple answer is to sell it.
I'm playing a browser game for about 10 years and "free" bots come and go but everyone is getting banned cause it's not easy to trick their software.
The key is to make your bot look like an actual player and simulate as best as you can a player's behavior.

Puppeteer helped me a lot with this. It actually opens a browser, so you can code it to do anything someone would do to visit a website/game

What game is it and for how much do these bots go for?

Brain_Drain · Dec 29, 2020

Grudge said:
What game is it

I'm talking about Grepolis.

Grudge said:
and for how much do these bots go for?

Depends on the bot. Others last for days, others for weeks, some are still around for basic tasks.
It's all about causing "unusual traffic" from a certain IP. Some made lots of unnecessary http requests so it was easy to detect

Brain_Drain · Dec 29, 2020

corameleviv said:
Thank you for explanation ... I can make bot with human behavor and bypass all spam filter ... Should i found someo'e with good knowledge in this domaine and maybe working together

If you are going to use Puppeteer, I suggest to setup a project and begin with simple tasks, like browsing around websites, type something in google a move the cursor to the "search" button. Just to get around with it

ReverseAndCode · Dec 29, 2020

thirdTicket said:
I have built some scrapers and bots in the past, and I'm looking for a meaningful way to intergrate them in some sort of a method or a strategy. Does anyone have some good ideas how to turn these skills into a successfull strategy?

I'm a big fan of the combination: social media app (without a website) -> scrape active users -> scrape friends of those users -> add/follow all found users/friends -> monetize

corameleviv · Dec 29, 2020

Brain_Drain said:
If you are going to use Puppeteer, I suggest to setup a project and begin with simple tasks, like browsing around websites, type something in google a move the cursor to the "search" button. Just to get around with it

Selenium...i have big experience in automation world

Roger Marquez · Dec 29, 2020

corameleviv said:
Good idea how can earn after scraping

Do you think the writing services being offered here on BHW charging pennies for a 500-word article are actually written? Fiverr is filled with these types of gigs. You can resell those articles on the market
You can use those articles to build web 2.0 properties and build links to your money site.

soralmabor2 · Dec 29, 2020

I would scrap targeted contacts from every social network I could. Then contact them with relevant offers.

ReverseAndCode · Dec 29, 2020

soralmabor2 said:
I would scrap targeted contacts from every social network I could. Then contact them with relevant offers.

That's basically what I wrote above and explained with a workflow already. ;-)

soralmabor2 · Dec 29, 2020

ReverseAndCode said:
That's basically what I wrote above and explained with a workflow already. ;-)

Exact ! But I wouldnt limits myself to DM, you can extract emails as well for example

ReverseAndCode · Dec 29, 2020

soralmabor2 said:
Exact ! But I wouldnt limits myself to DM, you can extract emails as well for example

The apps of large social networks like Instagram, Snapchat, TikTok - maybe also Badoo, Bumble, Hingle, Lovoo, Tinder - don't allow you to extract email addresses. The JSON responses don't contain this field.

Except the users wrote their email addresses into the public profile (bio). But that's like how many percent? I guess maximum 0,001 %? ;-)

Of course if there are bots behind the social media profiles you're going to scrape, they contain links to other networks or landing pages. But who would like to address bots?

soralmabor2 · Dec 29, 2020

ReverseAndCode said:
The apps of large social networks like Instagram, Snapchat, TikTok - maybe also Badoo, Bumble, Hingle, Lovoo, Tinder - don't allow you to extract email addresses. The JSON responses don't contain this field.

Except the users wrote their email addresses into the public profile (bio). But that's like how many percent? I guess maximum 0,001 %? ;-)

Of course if there are bots behind the social media profiles you're going to scrape, they contain links to other networks or landing pages. But who would like to address bots?

You are completly wrong my friend. Scrappers are able to scrap such informations. I do it for Instagram already

ReverseAndCode · Dec 29, 2020

soralmabor2 said:
You are completly wrong my friend. Scrappers are able to scrap such informations. I do it for Instagram already

I'm highly interested to see screenshots about TikTok, Snapchat, ... - Badoo, Bumble, Hinge, Lovoo, Tinder - revealing 100 % of the email addresses of their users.

And please, we don't talk about professional accounts or bot made accounts:

ReverseAndCode said:
Except the users wrote their email addresses into the public profile (bio). But that's like how many percent? I guess maximum 0,001 %? ;-)

Of course if there are bots behind the social media profiles you're going to scrape, they contain links to other networks or landing pages. But who would like to address bots?

But maybe I misunderstood you previously, because I thought you were talking about "scraping/scrapers". ;-)

Edit: Extended with my own quote

soralmabor2 · Dec 29, 2020

ReverseAndCode said:
I'm highly interested to see screenshots about TikTok, Snapchat, ... - Badoo, Bumble, Hinge, Lovoo, Tinder - revealing 100 % of the email addresses of their users.

And please, we don't talk about professional accounts or bot made accounts:

But maybe I misunderstood you previously, because I thought you were talking about "scraping/scrapers". ;-)

You are right, these cannot be scrapped.

Any scraper/bot ideas?

Newbie

Elite Member

Newbie

BANNED

BANNED

Newbie

BANNED

Power Member

Newbie

Newbie

Regular Member

BANNED

Elite Member

Newbie

Regular Member

Newbie

Regular Member

Newbie

Regular Member

Newbie

Main Menu

Marketplace

Making Money

BlackHat World