| Scraping Productivity Toolset | (BETA Testing)

kalrudra

BANNED
Joined
Oct 29, 2010
Messages
271
Reaction score
301
Hello Friends,

I am creating a new productivity tools for marketers.

This tools have following features.

• URLs management:

→ This tool finds duplicates from unlimited number of URLs (not limited to few hundred millions !!)

→ All links are saved in database

→ Import Any Number of text files to database

→ Trim URLs to ROOT and Filter duplicates

→ Keep TOP 'N' URLs from each domain. For example:
List is like:
http://www.google.com/gmail
http://www.google.com/gmail
http://www.google.com/gmail
http://www.live.com/mail

If we want only top 2 urls from each domain then output of the program will be:

http://www.google.com/gmail
http://www.live.com/mail


→ Remove Root Domains from given list.

http://www.live.com/
http://www.live.com/hotmail

output:
http://www.live.com/hotmail !!

→ Split result file in to number of files with 'N' lines per file.

→ Save all these settings in one place based on job and never have to figure out again and again.

• Search URLs:

→ Get URLs with specific domains (.com/.net/.org and so on..)

→ Get URLs with specific Text (for example all wordpress blogs or so..)

→ Export result to text file

• File Tools:

→ Merge Files: Merge two or more files in to single file

→ Split Files: Split single file in to number of files with each having specified number of lines.

→ Lines Counting: Count how many lines in give files.

• URL Tools:

→ Remove root domains (without removing duplicates)

I am looking for good beta testers for this

If you are interested in testing this tool please let me know.

Suggestions and questions are most welcomed.

Thanks,
Kalrudra

DOWNLOAD LINK: http://cid-9ac4d33499177b9b.office.live.com/self.aspx/Public/sec/Scraping%20Productivity%20Toolsets.rar

Requirement: .NET Framework 4.0
Link: http://msdn.microsoft.com/en-us/netframework/aa569263
 
Last edited:
I will provide download link if more than few people are interested..
 
I am interested in testing, how many URL's can it scrape per search?
 
if you can add a shuffle option to your program just like how it is with the add-on "blog analyzer" then that would be cool.
 
Download Link: http://cid-9ac4d33499177b9b.office.live.com/self.aspx/Public/sec/Scraping%20Productivity%20Toolsets.rar

Requirement: .NET Framework 4.0

http://msdn.microsoft.com/en-us/netframework/aa569263
 
Last edited:
hmm.. I have problem starting application... Program is not opening..
 
Let me know exact error message.

Also to run this program you will require .NET Framework 4.0.

Thanks
 
Back
Top