Web scraping and data extraction

C

confide

Newbie

Jul 7, 2012

19

4

• Oct 22, 2014

• #1

What would be the best language(s) to do this in?

Python? PHP? Java?

 

MisterNick

Registered Member

Oct 22, 2014

80

61

• Oct 22, 2014

• #2

Any programming language has that kind of function.I'm using C# .NET if i want to scrape some data from web

Good luck!

 

Repulsor

Senior Member

Jun 11, 2013

904

357

• Oct 22, 2014

• #3

I use PHP for web scraping. Its really handy. But PHP cant actually parse javascript content or else it would need high end coding to parse those.

I also getting into Vb.NET, to approach it from the BOT way. Just learning though.

 

Chris22

Regular Member

Sep 29, 2010

400

1,069

• Oct 22, 2014

• #4

If you don't have programming experience then don't bother. Check out import.io for scraping.

 

rootjazz

Elite Member

Dec 21, 2012

3,166

1,190

• Oct 28, 2014

• #5

The best language is the one you know.

The language really doesn't matter. They all do the same thing more or less.

Couple of if statements a few for loops, a class or two and you're there

 

member8200

Regular Member

Aug 9, 2014

477

33

• Oct 30, 2014

• #6

Python, PHP, Java can all do the trick, there's no the best for the job.
it doesn't matter what language you choose.

 

E

elhefe

Newbie

Jul 9, 2013

41

4

• Nov 18, 2014

• #7

If you're asking this question, you probably want the language you're most familiar with.

However if you're picking a language to learn and you really want to do serious scraping, don't pick one that will limit you in the future. You'll want a language that supports threading. While you could debate this, php and python are kinda out. Ruby might be a good way to go. Java could be a good way to go. What about using java and crawler4j? You'll never out grow that.