1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

how to "analyze" data i scrape from imacros with my own website?

Discussion in 'General Programming Chat' started by spla, Sep 17, 2015.

  1. spla

    spla Junior Member

    Joined:
    Jan 28, 2008
    Messages:
    139
    Likes Received:
    20
    Hello,
    i have some imacro twitter bots and i regularly scrape my follower numbers to see whats goes on.
    it looks like this:

    Account A (LS)
    "761","2015/07/05"
    "793","2015/07/06"
    "825","2015/07/07"
    "869","2015/07/08"

    Account B (GV)
    "228","2015/07/06"
    "270","2015/07/07"
    "298","2015/07/08"

    Account C (SA)
    "2",2015/07/07
    "14","2015/07/07"
    "42","2015/07/08"

    At the moment i use excel to analyze my data eg: % growth, total growth, gains last 7 days etc

    i want to have a mobile accessible website with my data analysis. any suggestions how i can achieve this?
     
  2. 9to5destroyer

    9to5destroyer Jr. VIP Jr. VIP

    Joined:
    Nov 14, 2011
    Messages:
    360
    Likes Received:
    207
    the easiest way would be to register a domain,create a db table for storing the information and display the analyse data by a php script via login. you could also add a script to auto scrape the data.

    Without programming maybe wordpress using a csv to DB plugin and a plugin to display database details in a table. I believe they exist but I've never used them.

    there's also plenty of other options if you want to display only on a local machine
    thanks
    9to5
     
  3. spla

    spla Junior Member

    Joined:
    Jan 28, 2008
    Messages:
    139
    Likes Received:
    20
    how would i find a script to autoscrape data? how would i start to look for (or write) a php script that can do the analysis? i am good with wordpress and got basic php skills but i cant write a script like that from scratch. if i google something like " bla php data analysis bla" i only find webpage visitor scripts or google analytic clones :(
     
  4. 9to5destroyer

    9to5destroyer Jr. VIP Jr. VIP

    Joined:
    Nov 14, 2011
    Messages:
    360
    Likes Received:
    207
    your likely not going to find a script that does it all for you. here's what you need to research and learn

    creating sql tables
    login with php
    scraping with php
    writing to database with php
    displaying sql data in grid with php

    a quick google should find you tons of info on each
     
  5. uncce

    uncce Junior Member

    Joined:
    Dec 24, 2014
    Messages:
    166
    Likes Received:
    27
    there is absolutely no need for php or sql. there are plenty of javascript frameworks for drawing pies and charts. flotcharts, chartjs