Instagram Posts Scrapy

FabioSelau

FabioSelau

Senior Member
Joined
Oct 19, 2018
Messages
812
Reaction score
451
Hello,
I use a public Instagram API to retrieve a user's basic data and their last 12 posts.
But I want to retrieve all posts from a user. I tested Instagrapi for Python but without success, out of every 10 reqs only 2 are successful.
Does anyone know any API or package (can be in Nodejs, PHP, Python...) that does this job?
It can be free or paid.
 
Advertise on BHW
Smackhead said:
Puppeteer or selenium will be fine for the job both available in node and python
Click to expand...
I know it's better than nothing but do you know the speed of these tools? To scrapy 1000 posts from a user, how many seconds do you think it would take? Would it arrive in minutes?
 
How quickly can you view 1000 posts for a single user if you do it on your phone? It will be take roughly the same amount of time.
 
FabioSelau said:
Hello,
I use a public Instagram API to retrieve a user's basic data and their last 12 posts.
But I want to retrieve all posts from a user. I tested Instagrapi for Python but without success, out of every 10 reqs only 2 are successful.
Does anyone know any API or package (can be in Nodejs, PHP, Python...) that does this job?
It can be free or paid.
Click to expand...
Selenium package is right thing for you.

FabioSelau said:
I know it's better than nothing but do you know the speed of these tools? To scrapy 1000 posts from a user, how many seconds do you think it would take? Would it arrive in minutes?
Click to expand...
Do not do it! Not only will it take time, but there is also the possibility of losing data... My recommendation is to set a limit i.e. range for something like this and create pages that would load, for example, 10 posts each.
 
I think that the best option is just using some stable solutions from RapidApi hub. There are many working versions with the free trial.
 
FabioSelau said:
Hello,
I use a public Instagram API to retrieve a user's basic data and their last 12 posts.
But I want to retrieve all posts from a user. I tested Instagrapi for Python but without success, out of every 10 reqs only 2 are successful.
Does anyone know any API or package (can be in Nodejs, PHP, Python...) that does this job?
It can be free or paid.
Click to expand...
Which Instagram API are you using for that?
 
I'd highly recommend taking time to invest in getting an http framework to work with JavaScript and such. The resources that a full browser instance take are immense and most are meant for testing not automation, especially Selenium.
 
FabioSelau said:
Hello,
I use a public Instagram API to retrieve a user's basic data and their last 12 posts.
But I want to retrieve all posts from a user. I tested Instagrapi for Python but without success, out of every 10 reqs only 2 are successful.
Does anyone know any API or package (can be in Nodejs, PHP, Python...) that does this job?
It can be free or paid.
Click to expand...

Which API do you use? I would like to be able to scrap 12 last post (and more if possible) from username in php
 
FabioSelau said:
Hello,
I use a public Instagram API to retrieve a user's basic data and their last 12 posts.
But I want to retrieve all posts from a user. I tested Instagrapi for Python but without success, out of every 10 reqs only 2 are successful.
Does anyone know any API or package (can be in Nodejs, PHP, Python...) that does this job?
It can be free or paid.
Click to expand...
Let handle this task for you as a Python programmer
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top