1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[Method] Split large txt/csv files in multiple pieces

Discussion in 'Black Hat SEO' started by kappa84, Feb 6, 2011.

  1. kappa84

    kappa84 Power Member

    Joined:
    May 19, 2010
    Messages:
    736
    Likes Received:
    337
    Location:
    Bath, UK
    I do not know if this belong here, however here it is. I needed this to split a .txt keywords list (about 4 million keywords) into small 10k pieces and had no idea how to do this (splitting lists by numbers), until I found gsplit...

    SO:

    1. Download gsplit.

    2. On "original file", click browse and choose your txt/csv large file.

    3. Click "Destination folder", "Browse" and select where you want to output your newly created files.

    4. Click "Type and size", click on "blocked pieces" and select from the drop-down ?I want to split after the nth occurrence of a specified pattern?; then choose ?Split after the occurrence number? and enter the number of lines you want your new files to contain (I've chosen 10,000 because I wanted x .txt files containing 10,000 keywords, so you choose whatever no. you want)

    5. Click "filenames" and on "piece name mask" write "{ofw}_{num}{ore}" (without the quotes) - this will name you new created files like kwds1.txt, kwds2.txt etc.

    6. Click "other properties" and check ?do not add tags to piece files?.

    This is it, it also works with very large text files with URLs and so on, hope it will help you. I searched a lot for this "trick" and once I found it I thought to share it with you (works great with ScrapeBox).

    Best!
     
    • Thanks Thanks x 8
  2. BugFixed

    BugFixed Junior Member

    Joined:
    Sep 24, 2010
    Messages:
    130
    Likes Received:
    40
    Another one: small, fast, and free File Splitter (for Windows)
    Code:
    http://www.filesplitter.org
     
    • Thanks Thanks x 1
  3. blackberry

    blackberry Power Member

    Joined:
    Apr 26, 2009
    Messages:
    719
    Likes Received:
    241
    Occupation:
    Making money
    Location:
    Planet Earth
    This will do exactly what your looking to do:
    Code:
    http://download.cnet.com/Npust-Email-List-Manager/3000-2369_4-10170841.html
     
    • Thanks Thanks x 1
  4. dichotom

    dichotom Elite Member

    Joined:
    Dec 9, 2008
    Messages:
    2,100
    Likes Received:
    558
    Two I have used are Text Wedge (good for small files and does many cool things) and HJsplit (not many options, but it can handle GIGANTIC files that all the other splitters choke on)
     
    • Thanks Thanks x 1
  5. Anubis1980

    Anubis1980 Regular Member

    Joined:
    Mar 20, 2010
    Messages:
    276
    Likes Received:
    81
    Occupation:
    webmaster and father
    Old thread here
     
    • Thanks Thanks x 1
  6. djmonster

    djmonster Regular Member

    Joined:
    Jan 16, 2010
    Messages:
    201
    Likes Received:
    39
    This is what I need .... Thank For the tutorial Op