1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Alternative to excel for pulling api data

Discussion in 'White Hat SEO' started by AgentZero, Nov 6, 2014.

  1. AgentZero

    AgentZero Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 10, 2008
    Messages:
    393
    Likes Received:
    83
    Occupation:
    Self Employed
    Location:
    Playboy Mansion
    Hi Guys,

    Pulling lots of data from semrush and moz, currently using excel its choppy as hell. Freezes, slow and crap.

    Is there any alternative tools out there which i can look at for pulling huge amounts of api data?

    Any suggestions would be very much appreciated and thanked!

    Cheers,
    AZ
     
  2. wuquater

    wuquater Junior Member

    Joined:
    Jan 1, 2013
    Messages:
    167
    Likes Received:
    63
    Location:
    no man's land
    Google spreadsheets
    I scrape webpages with it, i am sure it can communicate with api
     
  3. stonedmonkey

    stonedmonkey Registered Member

    Joined:
    Nov 4, 2014
    Messages:
    76
    Likes Received:
    7
    I would go for ms-access as the next logical step up and you should find it to be a lot faster due to how databases work with table indexing etc... You can even link ms-excel as a linked table within ms-access or alternatively populate the database table directly for the web service connection that you are using to populate excel... You need to have some vba knowledge with regards to developing a simple form to view/query the data... There are tons of examples online...
     
  4. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    707
    Likes Received:
    267
    Location:
    PHP Scripting ;)
    What volume are you talking about?<br><br>I have been using Excel 2007 to deal with all the api dumps in CSV format. Never had a problem. Probably I amnt extracting data at a volume that you are doing. I have had problems with Excel 2010 eing sloppy at times, but I use 2007 as of now.
     
  5. Big daddy

    Big daddy Newbie

    Joined:
    Apr 7, 2010
    Messages:
    16
    Likes Received:
    0
    Get a Programmer from e-lance, and get him to code you a script which keeps on running and stores data in a proper data base.