Whats Web Scraping with Java

hudsonhanson · Jan 8, 2024

I'm trying to get into web scraping using Java, but honestly, I'm kind of lost. I know Java pretty well, but scraping is new territory for me. I need to pull some data from a few websites for a project I'm working on

Gogol · Jan 8, 2024

Java or Javascript? I think you would be better off choosing Javascript for scraping (it should still be possible to scrape using Java though). Google "web scraping with node.js and puppeteer". There's lots of resources available for this.

NeedMyLink · Jan 9, 2024

Jump into web scraping with Java using the Jsoup library. It's great for parsing HTML and extracting data. Focus on understanding the HTML structure of target sites and use Jsoup to fetch the necessary info. Just be sure to respect legal boundaries and each site's scraping policy. It's a bit of a learning curve, but there's plenty of help out there in forums and tutorials.

proxygo · Jan 10, 2024

hudsonhanson said:
I'm trying to get into web scraping using Java, but honestly, I'm kind of lost. I know Java pretty well, but scraping is new territory for me. I need to pull some data from a few websites for a project I'm working on

wouldnt it save time to use a pre made scraper than java ?

Heixenberg · Jan 10, 2024

I think python is better and easier

cocklate123 · Jan 29, 2024

There's lots of resources available for this. Google "web scraping with node.js and puppeteer". Or you can find some scrapers to save your time on data scraping Octoparse scraper and more.

HenuSlayer · Apr 17, 2024

hudsonhanson said:
I'm trying to get into web scraping using Java, but honestly, I'm kind of lost. I know Java pretty well, but scraping is new territory for me. I need to pull some data from a few websites for a project I'm working on

If you are beginner I would recommend you to start from either Youtube Javascript tutorials or jump onto github for premade scripts. Here's few article if you want to try out your hands with step by step scraping to start with, they have listed the codes and real scraping snapshots
https://proxiesapi.com/articles/java
Out there are more but main focus as to be which phase you are in and how much work you want to put through.

Whats Web Scraping with Java

hudsonhanson

BANNED

Gogol

Administrator

NeedMyLink

Elite Member

proxygo

Elite Member

Heixenberg

Regular Member

cocklate123

Senior Member

HenuSlayer

Newbie

Main Menu

Marketplace

Making Money

BlackHat World