gleaning data about local businesses nationwide

m13-io

Newbie
Joined
Sep 22, 2019
Messages
4
Reaction score
3
#showerthoughts I was thinking about the data I have on hand and what information/data products I could build. phone number reverse lookups might be pretty easy start. Does that sound crazy? It would be a matter then of running each address through a pipeline to bolt on ancillary data about the given localized niche business or service. ex: Nursing Homes in CA - mash it up with calls to get the geo-codes based on the physical addr (plotted), run whois on any domains and catch the ownership/tech/admin/legal, display news stream relating to niche through filtered airtables & buffer, and a lot of other nearly nefarious things come to mind.

Am I allowed to post screen shots of progress I am making?

All the data I am working with is available to the public through any number of means, most notably data.gov. idk, maybe its crazy talk... if so delete this thread.
 
  • Like
Reactions: Yee
Sounds very interesting! I’m not sure what you mean with “filtered air tables & buffer” however i've been thinking of something similar, aggregate data from a variety of endpoints/db and build structured information. The set-up (building data, pipeline) is something I never did before so I'm interested in the screenshot of progress.
 
here is a pass over the data. The data source is about 10 MB. Using NimbleText, $25 for a license and great tool for nasty data.
 

Attachments

  • 2019-10-27 10_07_38-OBS Studio 23.2.1 (64-bit, windows) - Profile_ Untitled - Scenes_ Untitled.png
    2019-10-27 10_07_38-OBS Studio 23.2.1 (64-bit, windows) - Profile_ Untitled - Scenes_ Untitled.png
    77.5 KB · Views: 145
  • Like
Reactions: Yee
I had to lookup the meaning of Gleaning but basically this tool extract data from XML or triples and clean the data ?

I thought this data suppose to be structured
 
Back
Top