Is there a tool for this?

Bangaboom · Feb 13, 2019

I'd like to find a tool to scrape my IG followers (over 30k so needs to cope with big numbers) and list the number of followers they each have.

I'd like something that can do this without my IG password.

I know tools like Jarvee do this, but I don't want to give my password.

rudrapada · Feb 13, 2019

Bangaboom said:
I'd like to find a tool to scrape my IG followers (over 30k so needs to cope with big numbers) and list the number of followers they each have.

I'd like something that can do this without my IG password.

I know tools like Jarvee do this, but I don't want to give my password.

There's nothing wrong with Jarvee taking your password,
Jarvee spreads the scraping across different online accounts you have.
So jarvee (or any other sane bot for that matter) would be able to scrape 100% safely.

Chris.Roark · Feb 14, 2019

Do you know Python? You can create a scraper withing hours.

Regarding Jarvee, yes, it needs your password. But this is a locally installed app. Meaning that, even if you insert your password in Jarvee, it won't leave your PC. You will run it locally. And is the same as connecting your account through the browser.

rootjazz · Feb 15, 2019

The issue you will have is, scraping the 30k followers is straight forward. But to get the followers_count of each result, will require one request per result, so if you can get 100 results per request of your followers, you can scrape the 30,000 in 300 requests, BUT then you need to make 30,000 requests to get the followers of each. THIS will be the problem.

As stated above, the best way is if you have access to multiple accounts. Then you just tell your scrape action to share the requests over all accounts. i.e if you have 10 accounts, each account will make 3000 requests, if you have a 100, each account makes 300 requests.

rootjazz · Feb 15, 2019

Chris.Roark said:
Do you know Python? You can create a scraper withing hours.
.

slight simplication. You'll need account paging, testing to work out the best delays to use, the inevitable stupid whitespace errors you make because python

etc etc. Will take more than a few hours

itz_styx · Feb 15, 2019

if you have a list of all your followers already then you wont need to login nor use the IG api, just go to each profil url and parse the follower count.
could be done with a bash script, or if you use C with multithreads and proxies that would get it done faster.

rootjazz · Feb 15, 2019

itz_styx said:
if you have a list of all your followers already then you wont need to login nor use the IG api, just go to each profil url and parse the follower count.
could be done with a bash script, or if you use C with multithreads and proxies that would get it done faster.

of course! That's a much better way, then you can just throw proxies at it and bypass all API restrictions

Code:

userInteractionCount":"12345"

or parse from

Code:

"123.4k Followers, 123 Following

Bangaboom · Feb 16, 2019

Thanks so much for the advice guys.

That explanation from @rootjazz has helped me see it's a bit more involved than I'd assumed.

I don't have access to multiple accounts or proxies so maybe doing this is too risky for my account.

I used to use Jarvee and every time I did a full scrape of my followers IG would spank my account with an engagement drop - I guess because of all the actions involved. So I'm not keen to do it with Jarvee again.

I'd really just like to get a feel for how many "big hitters" I have among my followers and who they are.

It'd also be helpful to know who out the people I follow doesn't engage with my posts. I work hard to engage with the posts in my feed so if theyre not reciprocating it'd be good to unfollow them and replace with people who will reciprocate.

I know bots can do the engagement but I want to do it manually.

Chris.Roark · Feb 16, 2019

rootjazz said:
slight simplication. You'll need account paging, testing to work out the best delays to use, the inevitable stupid whitespace errors you make because python etc etc. Will take more than a few hours

Python with Beautiful soup. and set timeouts of several seconds.

It might take some time, but the action is doable

rootjazz · Feb 16, 2019

Bangaboom said:
Thanks so much for the advice guys.

That explanation from @rootjazz has helped me see it's a bit more involved than I'd assumed.

I don't have access to multiple accounts or proxies so maybe doing this is too risky for my account.

I used to use Jarvee and every time I did a full scrape of my followers IG would spank my account with an engagement drop - I guess because of all the actions involved. So I'm not keen to do it with Jarvee again.

I'd really just like to get a feel for how many "big hitters" I have among my followers and who they are.

It'd also be helpful to know who out the people I follow doesn't engage with my posts. I work hard to engage with the posts in my feed so if theyre not reciprocating it'd be good to unfollow them and replace with people who will reciprocate.

I know bots can do the engagement but I want to do it manually.

End of the day, if you want to do scraping, you need proxies. Maybe you can get away with 30k web page requests with your local IP, whilst testing this function yesterday, I pulled 1k results four / five times in a row with my local IP with no problem running at 10 and 20 threads. But long term, it would not be recommended.

As for getting your 30k followers, well for that you need buy a bot, or use a free libary and code one yourself.

With no access to accounts, nor proxies, you are not going to be scraping alot

I used to use Jarvee and every time I did a full scrape of my followers IG would spank my account with an engagement drop - I guess because of all the actions involved. So I'm not keen to do it with Jarvee again.

I haven't heard of engagement drops due to scraping 30k followers, but if it is a risk, then you need to get another account you can use for your scrapes, so if the engagement goes down, or worse (ban) it doesn't effect anything. This will allow you to avoid any penalties on your main account. For this, a bot that doesn't charge per user is going to best.

It'd also be helpful to know who out the people I follow doesn't engage with my posts. I work hard to engage with the posts in my feed so if theyre not reciprocating it'd be good to unfollow them and replace with people who will reciprocate.

Again, you need a bot. Many ways to due engagement scrapes. The typical one is to pull all your posts for (n) days, then scrape likers / commenters / story watchers, then see who of your followers is not engaging. But again, you need a bot and you need to scrape. But as above, you can use scrape accounts and not your main account.

End of the day, for what you want, you need
a bot
throwaway isg accounts
proxies

Otherwise it is not possible to do what you want

Is there a tool for this?

Bangaboom

Junior Member

rudrapada

Senior Member

Chris.Roark

Elite Member

rootjazz

Elite Member

rootjazz

Elite Member

itz_styx

Elite Member

rootjazz

Elite Member

Bangaboom

Junior Member

Chris.Roark

Elite Member

rootjazz

Elite Member

Main Menu

Marketplace

Making Money

BlackHatWorld

Other