[BETA TESTERS] Scrape Instagram and other platforms

Status
Not open for further replies.

thetrustedzone

Elite Member
Joined
Jun 15, 2010
Messages
3,994
Reaction score
3,462
Dear Beta Tester

PLEASE Read carefully this Post:

1. As Always in my beta tests active beta tester will get a free license or subscription or credits based on the product model after launching.
2.If you have any question/comment/bug reporting/feature suggestion/...etc Please Reply in this thread and do NOT pm/email/skype/Whatsapp me.
3. UI sucks for both web and desktop app in this beta I know will be improved later please focus on the functionality test.

To Join this beta please do the following :


PLEASE due to BHW rules sign up with your BHW username @beta.com fake email and username same your BHW username as follows Example:

signup.PNG






1. Sign up here


find your API key here and please reply in this thread to activate your API key.

2.Download the client tool from here (Mediafire link) - VT here -, and install it.


Please note the following:

A. It is All about proxies even if you have best scraper software and best IG accounts without good proxies you will fail, in my test i found most of data center proxies does not work what worked for best results were residential rotating proxies those give you new residential proxy each request,passed instagram proxies are not about being blocked or not blocked -as google technique- but about being detected or not detected, .e.g. if you want to visit instagram user profile instagram.com/user and got redircted to login page this mean your proxy is detected while it's not blocked,this is why your IG accounts got terminated too fast because you use them with already detected proxies, proxy sellers when confirming they sell working instagram proxies they need to check instagram is asking them to login to visit ig user profile or not, in short the proxy checker should check the HTTP response message status and headers and NOT the proxy timeout, i made online checker for proxy against instagram -no login required- could find it here if you don't want to use it you could test manually by yourself as follow : clear your browser cookies and make sure instagram not logged in and setup proxy you want to test and visit any instagram profile if redirected to login page this mean the proxy detected if not this mean the proxy not detected. most of the proxy sellers offer free trial try them before purchase.

B.While in this beta, you could use shared proxy built in the app but it HIGHLY RECOMMENDED to add your proxies from here.

c. some Instagram scraping requires IG accounts and some only proxies, current scraping requires only proxies and no Instagram accounts required as following:

1. Scrape ig hashtags.
2.Scrape ig usernames.
3.Download profile pic.
4.Scrape User details which contain:

UserName
FullName
biography
business_email (if available)
email_in_bio (if available)
user id:
website (if available)
category (if available)
sub_category (if available)
is_private : true of false
is_verified : true or false
is_joined_recently : true or false
is_business_account : true or false
followers_count
following_count
post_count
last_post_date : the date of last post .e.g. result 9/30/2020 8:05:22 AM

As said above no Instagram accounts required for above scraping, but upcoming Instagram scraping features requires Instagram accounts and not only proxy:

-Scrape users who liked or comment for specific Post.
-Scrape users who follow a specific user.


other platforms coming:

other platforms coming like similarweb only after Instagram scraping feedback coming.


for members who showed interest in this beta it's ready now (hope I didn't forget anyone):



You will new information about this beta in this thread in my replies and from this page


Thank you all!
 
Unknown app for windows 10, here is result.
View attachment 147730


Run it as administrator and allow to install, this tool is clean here's the VT.
it's better to install it on your VPS for faster results.

for people who showed interest in beta it's ready now could join it (hope I didn't forget anyone) :

Deleted member 1095690 @Themartian @penza @hungryforfb @Almazbek Kadyrov @BentMo @thedestroyer

@Socialmediaverve @bagdroll @elassar @eNzim @yellowcat


12.PNG




now the API key is auto-activated , but please reply with your username to confirm since any registration from outside BHW will be banned.
 
Registered, looking forward thanks! Which proxy provider do you personally use w the software?

Btw win defender blocked it as harmful. Any solution for that?
 
Thank you all, Update #1:

past download and install members just open the software and pop up message for update click update button, members who didn't install it could download from here and VT here (1 false positive).

1. Unknown publisher on win 10 should be fixed now, @eNzim @atrex @Intofantasy, please confirm.

2. Download profile pictures activated (checking this option will slower getting results due to download images time, but images download will not use proxies since Instagram save images on different hosting without anti-bot mechanism )

Regarding proxies best option to use Rotating Residential proxies give you new IP each request if give you new IP only every 5 minutes consider to use delay time in settings, check providers on BHW proxy marketplace here ask them for a free trial and test the proxy here.


Just did register
sending you a DM - email and API for activation
Interested & registered. Sending you details
goproseo count me in
Registered. Please activate and let me know.
Username : rickaloben
Is this working for anyone?
Signed up :)
Username wowlancer
Unknown app for windows 10
Signed up!! Waiting for API approval. Username is same as BHW username. Thanks
Just registered

User name: Sunil aryan

Looking forward.
Registered, looking forward thanks! Which proxy provider do you personally use w the software?

Btw win defender blocked it as harmful. Any solution for that?
ok, I just registered

username: minniemouse

thanks
 
Status
Not open for further replies.
Back
Top