Which is the best Free tool for this task?

N

neo3187

Senior Member

Sep 19, 2010

869

363

• Aug 1, 2013

• #1

Can anybody suggest a free tool in which I can put a list of URLs and it visits each URL ( Multithreaded or Singlethreaded ) and I can fix a specific area on a page from which it will scrape content from, for example, scrape a list/text below a specific heading, and store all that scraped content in an Excelsheet or a simple text file?

Thanks in advance.

 

D

Daxda

Newbie

May 8, 2013

10

4

• Aug 1, 2013

• #2

Hey there, mind telling me which site or what kind of text it should scrape?
I might be able to help you and create a quick tool for you

 

DunDidIt2X

Elite Member

Mar 22, 2012

2,863

2,432

• Aug 1, 2013

• #3

You will have to script different types of sites depending on what content you are after. If it is just business info that you are looking for their are all type of scrape tools in this forum-Just a Look DOWN at sig

 

N

neo3187

Senior Member

Sep 19, 2010

869

363

• Aug 1, 2013
• Thread Starter Thread Starter

• #4

No the style and format will be the same... say there is a certain footprint that I am looking for, so even the HTML will be same if that helps you guys in suggesting a good software.

For example,

Scrape the <ul> items ( in text format seperated by a new line ) under the heading Recent Posts - So the format will be same on every page, that is how il be getting a list of URLs using SB

 

Mnet17

Regular Member

Feb 28, 2013

209

139

• Aug 1, 2013

• #5

Go to iMacros.com and learn how to scrape the content yourself. It's a free tool

 

tuannguyen

Junior Member

Apr 25, 2012

151

27

• Aug 1, 2013

• #6

AutoIT can do that, easily way is reading the HTML code and extract information between 2 string

 

N

neo3187

Senior Member

Sep 19, 2010

869

363

• Aug 1, 2013
• Thread Starter Thread Starter

• #7

AutoIT is a scripting language right? Or do they have such tools also?

 

Q

qlwik

Newbie

Aug 18, 2011

48

10

• Aug 1, 2013

• #8

Zennoposter, not free but cheap.

 

Conor

Elite Member

Nov 7, 2012

3,621

6,217

• Aug 1, 2013

• #9

I'm pretty sure you can do that with Scrapebox... Try the free version of Gscraper too. That might help.

 

H

hpv222

Power Member

Feb 8, 2010

751

279

• Aug 1, 2013

• #10

Hmm, I seriously doubt that you will find off the shlef software (free or paid) that can do this for you .... unless you build or buy a custom one. A possible workaround would be do use htttrack to download all the pages (only pages, no images, etc.) and then use an advanced find and replace software to extract the text (data) that you are after

 

N

neo3187

Senior Member

Sep 19, 2010

869

363

• Aug 1, 2013
• Thread Starter Thread Starter

• #11

Treeofl1 said:

I'm pretty sure you can do that with Scrapebox... Try the free version of Gscraper too. That might help.

Click to expand...

I am not looking to scrape google, this is what il do

Scrape for URLs using SB --> Load those urls in some tool --> Extract a fixed pattern of content from each url( each webpage )