How to make money with Scrapping/Crawling

[hustler0395]

I'm curious to know about the kind of software or applications you would like to see utilizing this technology. Are there any specific industries, niches, or functionalities where scraping/crawling can bring significant value and generate revenue?

I'm open to any suggestions, ideas, or success stories you might have. Whether it's creating custom scraping tools for a particular domain, offering data analysis services, or any other innovative approach, I'm eager to learn and explore new possibilities.

If you've successfully monetized your scraping/crawling abilities or have come across interesting projects in this field, please share your experiences and insights. Your valuable input will be greatly appreciated not only by me but also by others who are looking to harness the potential of this technology.

Let's kickstart a discussion on how we can leverage web scraping and crawling for financial gain while maintaining ethical practices. I believe this community has a wealth of knowledge and diverse perspectives that can contribute to a fruitful conversation.

Thank you in advance for your valuable input, and I'm excited to hear your thoughts!

PS: please do not copy paste chat gpt answers thanks in advance

 

[limitless1337]

following

 

[mindeswx]

Usually, the harder it is to get some information the more valuable it is, but people usually want some 'leads', that's emails/phone numbers.
For example, you could scrape google maps for businesses, get their websites, scrape emails/phone numbers and sell them by category (fx. plumber/electrician/hairdresser etc.)
Sites like LinkedIn are harder to scrape because it requires accounts/connections, so the 'leads' are more valuable.

There is another approach to this, it's creating a 'proxy' for scraping.
Meaning you figure out exactly how to make the API requests, set up the proxies, solve CF/Recaptchas, and give clients the ability to very easily scrape sites like google without worrying about proxies/captchas and reverse engineering the requests.

 

[thedorf]

This is out in left field but if you can scrape the right websites, with the right data, you can train your own LLM (large language model) for AI. Sure there is a lot more to it than this but we can brainstorm right?

 

[hustler0395]

Usually, the harder it is to get some information the more valuable it is, but people usually want some 'leads', that's emails/phone numbers.
For example, you could scrape google maps for businesses, get their websites, scrape emails/phone numbers and sell them by category (fx. plumber/electrician/hairdresser etc.)
Sites like LinkedIn are harder to scrape because it requires accounts/connections, so the 'leads' are more valuable.

There is another approach to this, it's creating a 'proxy' for scraping.
Meaning you figure out exactly how to make the API requests, set up the proxies, solve CF/Recaptchas, and give clients the ability to very easily scrape sites like google without worrying about proxies/captchas and reverse engineering the requests.

Thanks for your input , i'm actually interested in the linkedin scrapping can you developpe it more like what can i scrap and who can i sell that data to

 

[SeasonedCode]

You can do many things scraping data
Scrap raw data filter it and sell
Scrape emails and phone numbers
Work as a freelance

But I prefer to add your sign for ex don't just sell the data make something with this data and create a product on top of this data then you can sell the product for higher price or even a monthly subscription

 

[hustler0395]

You can do many things scraping data
Scrap raw data filter it and sell
Scrape emails and phone numbers
Work as a freelance

But I prefer to add your sign for ex don't just sell the data make something with this data and create a product on top of this data then you can sell the product for higher price or even a monthly subscription

Thanks for your input , can you please explain more in details using an example as a case study and thanks in advance

 

[aimadnet]

You can build an API and sell data to businesses, I'm running currently top APIs that scrape millions of data daily.

Here is my story with RapidAPI:
https://rapidapi.com/developers/stories/aimad

 

[hustler0395]

You can build an API and sell data to businesses, I'm running currently top APIs that scrape millions of data daily.

Here is my story with RapidAPI:
https://rapidapi.com/developers/stories/aimad

nice a sat walakine i feel like its a pain in the a$$ to wait for customers knden 7sn ila saybt software (api zayd elih gha tkinter) o sell a subscription adkhl biha ktr fin b9a lblan howa f achnahowa had software li aybghiwh nass sat nta awl mghribi endo same goal b7ali baghi ydkhl l3a9a o hustler ila momkin ndiro rabit sada9a hh f telegram @hustler0395

ps:nvm just saw that you made 5 figures bhad rapid btw $ ola dh ?

 

[vinnyMS]

You could create an ambitious web scraper, as software. The obstacle is the time it takes to create it.

When the project is ambitious it takes longer to complete, it could take 2 years to create a web scraper that can scrap an Un scrapable website like facebook, amazon, match.com, etc. (match.com sounds uncommon to scrap but advanced)

for example, newton died before he completed his work because it takes 3 lives to complete

 

[hustler0395]

You could create an ambitious web scraper, as software. The obstacle is the time it takes to create it.

When the project is ambitious it takes longer to complete, it could take 2 years to create a web scraper that can scrap an Un scrapable website like facebook, amazon, match.com, etc. (match.com sounds uncommon to scrap but advanced)

for example, newton died before he completed his work because it takes 3 lives to complete

thanks for your input but i'm just trynna do some brain storming if you have any idea about any scrapping software that would sell like candy please don't hesitate even if it sounds big to be done as said i'm just brainstorming

 

[itz_styx]

nice a sat walakine i feel like its a pain in the a$$ to wait for customers knden 7sn ila saybt software (api zayd elih gha tkinter) o sell a subscription adkhl biha ktr fin b9a lblan howa f achnahowa had software li aybghiwh nass sat nta awl mghribi endo same goal b7ali baghi ydkhl l3a9a o hustler ila momkin ndiro rabit sada9a hh f telegram @hustler0395

ps:nvm just saw that you made 5 figures bhad rapid btw $ ola dh ?

what?

 

[aimadnet]

nice a sat walakine i feel like its a pain in the a$$ to wait for customers knden 7sn ila saybt software (api zayd elih gha tkinter) o sell a subscription adkhl biha ktr fin b9a lblan howa f achnahowa had software li aybghiwh nass sat nta awl mghribi endo same goal b7ali baghi ydkhl l3a9a o hustler ila momkin ndiro rabit sada9a hh f telegram @hustler0395

ps:nvm just saw that you made 5 figures bhad rapid btw $ ola dh ?

mr7ba, $ ofc

 

[vinnyMS]

thanks for your input but i'm just trynna do some brain storming if you have any idea about any scrapping software that would sell like candy please don't hesitate even if it sounds big to be done as said i'm just brainstorming

the software could work in intelligent ways but legal

the challenge is how to make it work no matter the website
it could work with triggers and conditions
all possible triggerable options of all possible combinations of website features all included in one software

sort of like a brute force word list, it works by trying thousands of combinations of strings to find which passes

there has to be a study of websites to target like researching how they work in the source code

The programmer will study 20 websites for a year then all of them appear the same way, with nothing else to add to the software, it is complete and ready to scrap all possible websites. they are similar after you study 20 of them

it works like this: you search, you find an option then you add it as a trigger. then it is done for that option. option after option the software is built to handle all posible actions and trigger responses

the software after you add all possible triggers (website options or features) will work no matter what it requires to do to scrap

 

[hustler0395]

mr7ba, $ ofc

ma maaan hh

 

[erinesta]

I have seen people offering web scraping services on Fiverr. However, you can also build websites like job aggregators and price comparison sites from the scraped data.

 

[denizseckin]

In my opinion, instead of dealing with finding customers for the data you have obtained, make money by providing this opportunity directly to people who want to obtain data but do not know how to do it. So don't sell fish. Buy a fishing rod where they can fish.
Develop and market software that can seamlessly scrape data from social media platforms, sites that require captcha resolution or login. It may sound silly to you, mine is just an idea.

 

[Ramc6]

You can build an API and sell data to businesses, I'm running currently top APIs that scrape millions of data daily.

Here is my story with RapidAPI:
https://rapidapi.com/developers/stories/aimad

How to contact you, do you have Telegram or Ws?

 

[Ramc6]

How to contact you, do you have Telegram or Ws?