Search results

Nice work. I’m also looking to explore selling either custom web scrapers or scraped data. I’ve heard of Apify and noticed they have a marketplace for selling spiders (actors), but I’m curious if anyone here has had any success with that platform? What niche are you going with here?

Welcome, I hope you find what you're looking for.

Discount and sample list niche list please

Hello and welcome to BHW

Hiya BHW, I was wondering if anyone has had successes with selling customer art on products on Redbubble or anything similar. I enjoyed making AI art with hotpot.ai when it was free, but would consider using Leonardo AI Image Generator or Night Cafe. I'm looking for any advice as to how...

I am interested in where you acquire these products or are creating them yourself? I have a couple data sets I web scraped Id like to sell if you have any ideas.

This is great motivation. I'm new to Medium and just wrote two articles with links to my web scraping fiverr page with lots of help from AI. Planning to write a couple of stories a week. Need to engage with the community. Did you get publishers to pick you up? If its linking back to your site...

I am mainly focused on scraping public websites. Have you checked into the legality of this? Did you pay to get access?

I find the free version of Chat GPT very helpful. I use it to find and correct errors and help me to further understand areas to build what I need. It has started to hit a paywall sometimes when I use it a lot, so I may end up paying soon. With virtual environments running a framework like...

This is a pretty good idea. It would be a lot of time spent making the tutorials, but as they say the ones getting rich in the gold rush are selling the shovels. Thanks for all the valuable insight.

I like this idea. It is a niche type of service that the average Joe doesn't need. My portfolio is a collection of databases I've scraped from the web. I have to admit that they are not very sexy. I think the analytics I could run on the data would be more appealing, especially with data...

Maybe I am a lil' crazy my dude. I don't want to waste time in a race to the bottom bidding on UpWork as this time. I have the Fivver setup now I just need to generate traffic. I read about using CL on an advice blog for freelance webdev. I know it may not be a good fit for this specialized...

Hi, I'm new here as well. I would say post in the lounge and the other forums that interest you. I hope you find what you are after.

Hello BHW, I just set up a new account to offer freelance web scraping/ data extraction services on the Fivverr platform. I plan on advertising on Craigslist soon. Should I only go for my local area only as they require? Any other platforms I should look into to pull clients in? I need to keep...

I like your attitude! I have only used local infrastructure so far. I'm very interested in the idea of hosting a database or using cloud compute. Might need a client first. Could be good for data mining due to cloud elasticity. I've heard to be weary of AWS. If you're not careful you could get...

Hello BlackHatters, I am curious to hear about what kinds of setups people used to do web scraping on a web host and what provider. I heard Digital Ocean can be an affordable option but I know there must be some drawbacks. AWS is also another option but interested in what others use for their...

I would start with a basic python course to get a little elementary knowledge. The CS50 would be a free way to follow a structured course. Also, just download Thonny and play around with making simple programs. Code every day. Good luck...

What are you trying to do with this? Just seek a better understanding of the structure and flow? I would say feed this into an LLM like Chat GPT. I have had it analyze some pretty niche error codes and it helped me get a better grasp.

I'm interesting in different counter measures myself. I have never used proxy IPs or had to solve a CAPTCHA. I've made spiders with Selenium and now use the Scrapy framework. Specifically with Splash/LUA in-bedded in Scrapy and implementing Splash via a docker web server. I'm curious how much...

Hello BHW, Just finished another spider using Scrapy. Last one I made pulled info on lego mini figurines. This time I went with car data. End result is a SQLite DB of 266 rows with Name, Price and Rating. With every website's structure being different, I ran into some snags with my crawler...