Need help with scrapping

Advertise on BHW
Legendary_MaaN said:
i don't know. my client needs this data, i'm still researching and still haven't found any website where this data is shown publicly
Click to expand...
then you are asking us to help you solve an equation with 3 unknowns, and you are giving half the data of one of them, it is difficult to advise here

universal solution step by step:
1. find source/website with desired data
2. code/build scraper to scrape this
3. save it into database and then deliver to clients
done
 
Find someone who can write a crawler program in python, or if you know how, you can write it yourself. You can check whether its data is encrypted
 
Legendary_MaaN said:
I need to scrap data about property owners in a certain location, suggest me tools and ways to do that please.
Click to expand...
Lesson 1: It’s scraping, not scrapping. Scraping and scrapping aren’t the same thing.

As for tools, my tool of choice is node.js + puppeteer. But it might actually be possible to scrape the data just using http requests. In that case use a fetch client like axios and something like cheerios to get the data easily. That should do it much quicker. It depends on the site you are trying to scrape.
 
A scraping program or python script with residential proxies will allow you to target whatever location you want
 
In some countries residential property owners database are publicly available just google search location + residential property database. Some free and some paid.
 
Gogol said:
Lesson 1: It’s scraping, not scrapping. Scraping and scrapping aren’t the same thing.

As for tools, my tool of choice is node.js + puppeteer. But it might actually be possible to scrape the data just using http requests. In that case use a fetch client like axios and something like cheerios to get the data easily. That should do it much quicker. It depends on the site you are trying to scrape.
Click to expand...
Did you try scrapingrocket?

It does all of what you suggested without any coding.

It has a Visual Selector page that displays the scraped web page within an iframe.

You simply need to click on the elements you want to extract from the web page.

This action will generate a Cheerio config file, which you can then use on other similar URLs to extract data in JSON format.
 
mchabchoub said:
Did you try scrapingrocket?

It does all of what you suggested without any coding.

It has a Visual Selector page that displays the scraped web page within an iframe.

You simply need to click on the elements you want to extract from the web page.

This action will generate a Cheerio config file, which you can then use on other similar URLs to extract data in JSON format.
Click to expand...
No, I haven’t. But this sounds pretty interesting. I will give it a try if a project like that comes up in future.
 
Have you looked at using web scraping libraries in Python like Beautiful Soup or Scrapy? Just be mindful of the website's terms of service and robots.txt file before you start.
 
Web scraping can be tricky; have you looked at using a service like PropStream or is that too pricey for what you're trying to do?
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top