How much RAM is needed to open a 1 GB+ Notepad file?

hardcorebiker

Elite Member

Sep 6, 2011

2,486

1,256

• Feb 14, 2013

• #1

I was trying out the new GScraper and it generated a 1 GB file+ which my VPS isn't able to open(Its just 1GB ram). It keeps on hanging and the software also isn't able to handle that load. Any solution to this?

 

Furious George

Supreme Member

Dec 13, 2012

1,438

2,188

• Feb 14, 2013

• #2

Upload it to google docs, download it on your computer?

 

Panther28

Elite Member

Executive VIP

Jr. VIP

May 2, 2010

9,947

16,057

• Feb 14, 2013

• #3

unless there is software that can create virtual memory, then i would say impossible, configuring that would be tough too.

 

metra

Junior Member

Jun 6, 2012

156

50

• Feb 14, 2013

• #4

hardcorebiker said:

I was trying out the new GScraper and it generated a 1 GB file+ which my VPS isn't able to open(Its just 1GB ram). It keeps on hanging and the software also isn't able to handle that load. Any solution to this?

Click to expand...

Even on my 8 GB Desktop, notepad will always take ages to open very large text files. I've noticed that wordpad works better with the larger files (but will still eventually freeze up.)

Text editors with 2GB limit: Notepad++, Jujuedit, TextPad
Recommended for large files: gVim

Doesn't hurt to try some of these out - a few load the file into memory first (and a lot of software uses virtual memory these days); it's worth a shot.

Best,
- Metra

 

Last edited: Feb 14, 2013

bertbaby

Elite Member

Apr 15, 2009

2,025

1,535

• Feb 14, 2013

• #5

Break it up and then open the pieces to be added to an Access database.

 

R

radikal

Registered Member

Nov 15, 2011

57

13

• Feb 25, 2013

• #6

To avoid this happening in future you can go to the options tab and select 'create new text if lines >' and then set the amount to something that your vps can handle. I have mine set at 500,000. The program then saves a maximum of 500,000 results per text file which makes them much more manageable and will eliminate the memory problems you get when you try to open files containing millions of results.

 

thetrustedzone

Elite Member

Jun 15, 2010

3,994

3,462

• Feb 25, 2013

• #7

use Notepad++ to open it

 

satyr85

Elite Member

Jr. Executive VIP

Jr. VIP

Aug 7, 2011

1,577

1,432

• Feb 25, 2013

• #8

Removing duplicates from 2.3 gig file in gscraper take about 7-8 gig of ram on my dedi. Notepad++ cant open 500 mb file on my dedi so it wont help. Split that file using gscraper and make smaller files so you can open them. P.S. you didnt bought ovh dedi ?