Lets Build a Proper Pinterest Scraper (i build you advise)

[neOtron]

Disclaimer :
As i will be building a live Tool here so it might sound very skeptical that i m trying to sell my product without a sales thread here.
Well of course if i build a descent product i might want to sell it but as of now i have no product to sell lol .
i am just starting to code it, and i dont know where it will go , even if i will continue building this tool or not, i am doing it here as i need some advice from you for building this tool .
Maybe consider this a beta testing thread or something.
I promise if i have something sell-able i will create a proper sales thread although i m sure that it will reach that step because Pinterest Automation is easy but keeping the accounts alive is damn difficult.
Anyways if MODS want i can create a dummy sales thread right now although i am not sure what will i put in the sales thread as i have nothing to sell right now lol. In anycase, please let me know if there is any issue with this thread.

ANYWAY MOVING ON...

So , I am curious about pinterest now a days. Truth be told few years ago i tried pinterest but failed terribly. This time i decided to give it a proper go.

A few days ago i built a eCommerce site for a local client who owns a Face Cream manufacturing company. and he asked me if i could help him with social media like pinterest to build up accounts , gather followers and market their products. well i have never worked with pinterest but i cant tell my client that right so i bought some time to do my own research.

And i started doing my research regarding , who to follow, how to follow, how to gather data etc etc and soon i got frustrated by all the manual labour :/ I just want a list of goody goody pinterest users on my 'body care' niche , users who are active , who like to follow other people etc etc. so i decided to build my own tool as my i need some specific stuffs that other bots cant provide me.

So yesterday i started to figure out how to build this tool, what kind of data pr interest provides and what should i collect and store ...

Anyways so first of all i wanted users by their location and pinterest dont show it so easliy, Also i wanted to avoid other marketers account so first of all i built this tool :

Tool 1 : Pinterest User Basic Statistics scraper :
Collecting Data which is available to public. Without logging in.

Live link of incomplete tool : https://beta.ineotron.com/tools/pinterest/check_user_stats.php

You can check any pinterest details here. just enter pinterest username

So after cleaning up all the junk data, i figured the following data is useful so i m displaying it on the page.

Please note that my scraper ip was from germany server and here on the above screenshot the mentioned profile location is 'US' but also 'india' is mentioned in 'location' section which means this user logs in from india ip address.Which tells me that the user is actually indian and also a marketers . or atleast that is what i understand. Feel free to comment. Anyway Its worth nothing that pinterest keeps track of this.

HOWEVER, After building this i noticed that when i visit this user's profile when i m logged in i also get to see his 'Average monthly Pageviews' but this data is not available here.

So i started working on how to find those monthly views data it is important for me.
so when we scrape the user's profile as a logged in user , here is the result :

Second Tool - Pinterest User Advanced Statistics scraper
Data we can get if we scrape using a Logged in . This Tool give a extra information like: User's Monthly Visits, last_pin_save_time, Email address is exists, Verified Phone Number if available

Live Link for this tool : https://beta.ineotron.com/tools/pinterest/check_user_stats_detailed.php

I haven't cleaned this data yet as i m little confused about what data is useful and what not. this is one of the reason i decided to make this thread so that i can get your advise as well.
Anyway look at the data we get as an logged in user :

See all these values. this particular username also displaying his email. and there alot of other things to nitice here

pinterest keep track of who is repinning ,

I wonder what is : is_tastemaker , pins_done_count

Pinterest keeps track if the user's profile is indexed in google or not

i noticed that for several profile even if the followers/following count is high but the page reach is -1

I m still wondering what data to keep and what to discard .

I also created some simple tool to extract the followers list.

Third Tool - Pinterest User Followers scraper Basic
Extract Pinterest user's followers. Just scraping first 50 followers for now.

Live Link of tool : https://beta.ineotron.com/tools/pinterest/check_user_followers_list.php

Havent cleaned this data. just displaying full data for now. will arrange it tomorrow


Fourth Tool - Pinterest User Followers scraper Advanced
Extract Pinterest user's followers. Just scraping first 500 followers for now. Can be scraped more but this will break the server because of Huge CPU load. so stopping the script after first 500 for now. will think about later about running the scraper task in background to scrape continuously.

Live Link of tool : https://beta.ineotron.com/tools/pinterest/check_user_followers_list_advanced.php


That's enough for now. I will continue improving this tomorrow.

Please feel free to comment and advise

 

[neOtron]

Update:
Fixed the Second tool. displaying the raw data properly in the nested table now.
Made Data model for user statistics so that data can be stored in the database.

Note: earlier i mentioned that pinterest keep track of the repinners attached with the accounts mains stats. however its was the inverse. its actually the list people the current user is repinning content.

Working on fixing the followers gathering script now

 

[TomTheCat]

You should sanitize the url from Direct Link to Result Page

 

[neOtron]

You should sanitize the url from Direct Link to Result Page

Thought i was already doing it. can you please show me the exploit?

 

[Dj.76]

these some data i usually collected

Username => dime24
Full Name => Diana Mendez
ID => 352547614488537649
Website Url =>
Board Count => 20
Pin Count => 518
Last PIN => Sun, 11 Oct 2020 17:24:18 +0000
Follower => 37
Following => 232
Profile Reach => -1
Indexed => false
Noindex Reason =>

 

[neOtron]

these some data i usually collected

Username => dime24
Full Name => Diana Mendez
ID => 352547614488537649
Website Url =>
Board Count => 20
Pin Count => 518
Last PIN => Sun, 11 Oct 2020 17:24:18 +0000
Follower => 37
Following => 232
Profile Reach => -1
Indexed => false
Noindex Reason =>

Thanks for the info.
but what is 'Noindex Reason' i never found this anywhere in any of the returned data from pinterest . can you please explain

 

[neOtron]

Final update for today :
a) Fixed the followers scraper , Thanks to @TomTheCat i realised that i forgot to include XSS prevention package.
b) Displaying the data in proper format. in four formats in total
If the number of followers exceeds 50 then another link will appear in the page . clicking on which the next set of 50 followers will be scarped and so on

clicking on the highlighted will go to next page which will scrape next set of followers. This link will appear as long as the user has more followers to be scraped

c) Removed the 4th tool as the functionality has been integrated with the third tool .

Tomorrow i will setup a Bigdata system in a server as i want to start by scraping few millions Users Statistics to work on niche filters and other kind of reporting system .

 

[bendutchman]

WOW! That's a really great tool. Thank you so much for sharing it with us.

 

[tuwoshuai]

Great tool!

Anyway to scrape pins data? like likes of pins on given profile.

 

[neOtron]

Great tool!

Anyway to scrape pins data? like likes of pins on given profile.

ok i just updated the tool with the "pins scraper", "board lists scraper" and Pin statistics

For Boards scraper visit this : https://beta.ineotron.com/tools/pinterest/check_user_boards_list.php
and enter the username :
It will show result like this :

For next set of board just click the link "Fetch Next Page of Boards " .
it will keep showing next pages untill the last page is reached.

--------
For pins scraper visit this link : https://beta.ineotron.com/tools/pinterest/check_user_pins_list.php
Same funda as above

For Details of any individual pin : https://beta.ineotron.com/tools/pinterest/check_pin_stats.php

This also provide data like Original pinner details, rich text Data

 

[tuwoshuai]

Really appreciated!

Save us a lot of time!

 

[Adam Serifen]

Great Tools!

 

[forwardedlandlines]

You are the best possible Pinterest builder of all time! It takes something to realize something! And it takes a little push to make flow happen! I'm not angry at you! I am happy at you!

 

[potato165]

is there any way to download all user's images with the title as image name bro?

 

[lorand]

I made somethign similar but for the source page the problem is that Pinterest count repins till 9

 

[Phuketmomay]

OMG ! This will help me a lot on Pinterest ! Thanks so much it's not enough for this so I attach to my Thanks also a very Big Kiss

 

[bhcg101]

Thanks OP for putting in the time to build the tool. Great job !

 

[CyHead]

It looks cool - just wondering if interest still has an active user base worth gaming at this point?

They have great SEO, but it feels like they don't have a lot of active users.

 

[Josh Saga]

It looks cool - just wondering if interest still has an active user base worth gaming at this point?

They have great SEO, but it feels like they don't have a lot of active users.

Depends on Niche - others niches have been swamped with bots farms doing Pinterest Pyramid

 

[neOtron]

To the guy who is trying to send automated request to my beta site and scrape the content (IP 51.210.182.66 )-

i m shutting down the demo panel thanks to your stupidity .