Extracting Data / Emails

ThisHat

Newbie

Jun 7, 2017

7

1

• Jun 7, 2017

• #1

Hi there,

Perhaps a newbie question but I'm here to learn. I've got a website which lists its data in a table as follows:
name | address | phone | email

This is spread across just over 5000 pages with 10 lines of entry on each page. I'm looking for a way to pull this data into a spreadsheet (to later email them) without having to individually visit each page.

What are your recommendations?

Thanks in advance!

 

payal23j

Elite Member

Jr. VIP

Aug 19, 2009

2,808

854

• Jun 7, 2017

• #2

So you need bot or manually data mining?

 

ThisHat

Newbie

Jun 7, 2017

7

1

• Jun 7, 2017
• Thread Starter Thread Starter

• #3

payal23j said:

So you need bot or manually data mining?

Click to expand...

Preferably a bot I've looked at import.io, atomic email etc.. but to be honest the emails are just right there infront of me. Not really sure what the right tool for the job is.

Do you think it'd be better posting this in the marketplace section?

 

T

techwort

BANNED

Jun 7, 2017

80

3

• Jun 7, 2017

• #4

just search for advanced email extracter

 

Zelgar

Newbie

May 25, 2017

11

2

• Jun 7, 2017

• #5

There is a google extension called Web Scraper that should handle this easily. I wouldn't spend money on a program if you just need to handle tabular data and basic pagination.

 

HoNeYBiRD

Elite Member

May 1, 2009

10,187

12,580

• Jun 7, 2017

• #6

If the data is ordered by the same manner on each page, you can record a macro with iMacros easily, then play it in loop. Imacros can extract to an Excel file/spreadsheet. I'd say it would take around half a day to extract all 5,000 pages taking into account the page load times too, once a page is loaded, the extraction requires only a moment.

 

payal23j

Elite Member

Jr. VIP

Aug 19, 2009

2,808

854

• Jun 7, 2017

• #7

No, just post/move this thread on HAF.

ThisHat said:

Preferably a bot I've looked at import.io, atomic email etc.. but to be honest the emails are just right there infront of me. Not really sure what the right tool for the job is.

Do you think it'd be better posting this in the marketplace section?

Click to expand...

 

GoDesain

Regular Member

Feb 26, 2011

491

224

• Jun 7, 2017

• #8

if you want learn python, try https://scrapy.org/..
better to scrap content..

 

ThisHat

Newbie

Jun 7, 2017

7

1

• Jun 8, 2017
• Thread Starter Thread Starter

• #9

Thanks for all the replies! Really helpful here. iMacros is a great tool however the page load times are diabolical so this makes it a little bit too slow.

Trying my hand at Web Scraper now, thanks for suggesting that Zelgar