import 26M urls into gscaper and crashing

A

aarongoldsten

Junior Member

Oct 22, 2014

177

64

• Aug 7, 2015

• #1

I keep trying to import 26 million urls into gscraper and it keeps freezing.

also memory on vps is 90% disk c is 100%. I am wondering if the list I trying import to big? that why keep freezing?

or what I can do to fix it? i just need to import list 26M urls into gscraper

 

E

ekapek

Regular Member

Aug 2, 2010

274

58

• Aug 7, 2015

• #2

Upgrade vps to have more memory or just split yours list. Why can't you just split it?

 

davids355

Super Moderator

Moderator

Executive VIP

Jr. VIP

Apr 25, 2011

19,848

28,296

• Aug 7, 2015

• #3

Sounds like you need more power. As above, upgrade your VPS or split the lists.
You can use scrapebox if you have it to split the list into 10 or something and then try again.

 

W

watley

Power Member

Oct 17, 2012

526

240

• Aug 7, 2015

• #4

This comes as a surprise? You need a better VPS.

 

SoccerLover

Elite Member

Jun 12, 2014

5,007

2,773

• Aug 7, 2015

• #5

26m is a huge amount, you need to upgrade current vps or go on with the dedicated stuff