1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Any idea about script what allows me store influencers data?

Discussion in 'Scripting' started by richdaddy7, Jul 20, 2017.

  1. richdaddy7

    richdaddy7 Registered Member

    Joined:
    Jul 5, 2016
    Messages:
    56
    Likes Received:
    3
    Hello, I looking for a script what allows me to store influencers data like: followers, following, reach of the account etc. something like a database. I searched for it a lot but without results. Do you know some script or something like that what allows me this features? :)
     
  2. HostStage

    HostStage Jr. VIP Jr. VIP

    Joined:
    May 20, 2010
    Messages:
    1,873
    Likes Received:
    1,768
    Occupation:
    BHW - CEO of Webhosting Company
    Location:
    BWH from France
    Home Page:
    Excel :D

    Obvious aside, I don't know such kind of tools and it sounds you would need something custom here.
     
  3. threeplayer

    threeplayer Newbie

    Joined:
    Apr 14, 2007
    Messages:
    21
    Likes Received:
    2
    I can create a script for you that utilizes twitters streaming api to grab and update the information you require into a database, based on a list of influencers you provide.

    Let me know if you're interested.
     
  4. mlori

    mlori Newbie

    Joined:
    Jul 31, 2017
    Messages:
    12
    Likes Received:
    2
    Gender:
    Male
    Never seen a custom script that does that, you should probably hire somebody to do it, pm me if you need a coder
     
  5. Marcel Freiberg

    Marcel Freiberg Newbie

    Joined:
    Aug 6, 2017
    Messages:
    38
    Likes Received:
    8
    Gender:
    Male
    Hi,

    for instagram you could start by writing your own simple script. Public profiles informations are easy to get thru the combination of the url and the username. Even a simple wget-command from the command line of a unix system would download a profile page e.g. wget URL.
    Instead of downloading the file I would check up some simple python oder perl tutorials to work with http-request to get an object instead of an file.
    Most important part of the downloaded webpage or the object is the part behind "window._sharedData =" (you could use your Browser and look at the page source code and search for this term. Behind the equal sign you will find a nearly endless part between the brackets. The JSON data.
    You can use a online tool (search for json online viewer) and paste the text string with the brackets to see a structured view for the data (see screenshot example.png).
    The easiest way to store the data would be a mongodb because of the simple addition of json files. On the other hand I do not know which queries you are planning to execute which could be a bit more difficult in mongo.

    Every scripting or programming language you choose should be able to:
    1. Loop a list of namens
    2. Excecute a http-Request
    3. Extract the relevant JSON-Data (search for Term, use beautyfulsoup with python, ...)
    4. Store it either in a structured way or unstructured as the json

    Example Data included in the json:
    Name, Amount followers, amount following, urls, urls to profile pictures but also media information from the last 12 posts (comments each post, ...)

    Best luck
    mf
     

    Attached Files: