Excel tools - Need some help with huge volumes of data

Hey, so I've got ~27 excel files ( I do an export each week) with data in each column.

Each file has ~100k rows and ~50 columns of data.

In order to be able to use the data in a more efficient way, I need to be able to

1. extrapolate certain columns of data into a new workbook
2. check for duplicate rows
3. remove duplicate rows (leaving only one of the duplicates)
4. and save that as an excel worksheet/workbook.

Does anyone else use anything that might help me with this? because as it stands, I've got over 2.7million rows of data and I need about 10 columns from it (aka lots of manual labor), not to mention checking for dupes.

Thx ahead.

if by some how in excel ,above thing possible then good
otherwise,if you need,I can make a Bot to do that job for you

try asap utilities for excel (free download) - it can remove duplicates and just leave one instance, should do the trick for you

trevormorley said:

try asap utilities for excel (free download) - it can remove duplicates and just leave one instance, should do the trick for you

Click to expand...

I'll check it out, thanks.. I know I can remove dupes using Excel itself, but will asap utilities then combine the remaining data?