asiavirtualsolution
Regular Member
- May 18, 2013
- 313
- 68
I need something that can clean large url list.
I have a url list, now i scraped another list, but i want only the urls that is new and not already in the old list ( unique urls).
I want to input: list a + List b = Output should be the difference between the 2
Option to save the output to txt file
Conditions:
Drop me a PM if you can do it with your reasonable price and how long it will take to get done, or get me on skype.
I have a url list, now i scraped another list, but i want only the urls that is new and not already in the old list ( unique urls).
I want to input: list a + List b = Output should be the difference between the 2
Option to save the output to txt file
Conditions:
- Must be a windows app ( should run on win 8.1
- Must be 64 bit
- Should be able to handle url list exceeding 20 million urls ( 10Gb )
- This is for personal use so no need for any fancy GUI, just need it to be practical
Drop me a PM if you can do it with your reasonable price and how long it will take to get done, or get me on skype.
