Need advice for web scraping

Mediawiz

Mediawiz

Power Member
Joined
Apr 19, 2016
Messages
512
Reaction score
635
Hi, I’m looking for some advice regarding web scraping. I want to scrape data from tables in two ways;

The full list of a website
Only results with a certain keyword (using search function)

What is the best software to do this? There are a lot of tools available but I’m not sure what I need.

Thanks!
 
Advertise on BHW
It depends on what website you are trying to scrape to get data from. Is it a specific site or just websites in general?
 
From your description Outwit Hub should do what you need. Once you have built the scraper you save it and you can run it everytime you need it. The more expensive version of it has scheduled tasks but I haven't had the need for that kind of automation to spend the money for the advanced one.
They have a free version (with limited scrape lines) and plugin for Firefox. I haven't used the firefox plugin in years so I can't advise for or against it but if memory serves its pretty easy to use. If you download the free version of hub and need some help IM me.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top