Question: Scraping users with specific links in bio?
- Thread starter XOTW3D
- Start date
LazyGram420
Junior Member
- Jan 10, 2020
- 121
- 36
I won't suggest a specific program, but if you do use automated scraping software, make sure to use a virtual machine with a dedicated proxy since most software you can find publicly available communicates through Instagram's API, which means they can see that you're using automated software and there's a risk your profile will receive restrictions or a shadowban.
TheGreyMatter
BANNED
- Mar 23, 2011
- 3,697
- 4,060
Public bots though don't work well but have an option to search for through keywords, you can do a quick research on what 'words' music artists are using frequently in their bio and run it accordingly. If not, then you can scrape them in bulk using hashtags and then sort them out accordingly from the final CSV file.
rootjazz
Elite Member
- Dec 21, 2012
- 3,166
- 1,190
IIRC the instagram USERNAME SEARCH endpoint includes results from the bio. So you can just use any program with username search and include soundcloud.
Another method is to perform a google search with various modifiers to get only instagram profile pages with soundcloud in the bio. Your bot should also allow this function
Another method is to perform a google search with various modifiers to get only instagram profile pages with soundcloud in the bio. Your bot should also allow this function
rootjazz
Elite Member
- Dec 21, 2012
- 3,166
- 1,190
What difference does a virtual machine make? It doesn't make any.
Assuming you are correct on the instagram API part (and if you mean the public API you are not) using a VM or proxy will have no bearing on this at all. Assuming what you say is correct (I disagree, but assuming), a VM and proxy will not do anything to protect your account from restrictions of ban at all.
rootjazz
Elite Member
- Dec 21, 2012
- 3,166
- 1,190
Yes you can scrape through other words / tags someone with a soundcloud might use, then filter out those without a soundcloud, but how does this work better? When ever you start to filter out, you are making more requests to get the results you want due to ignoring results, this is where the problems come in, if you want 1000 results and you are ignoring 50% of results, you need to make 2000 results. Heavy filtering is how you lead to problems through too many requests. Sometimes there is no other way (locations for example) but in the OPs case they can do this - search for soundcloud links so that is the way togo
LazyGram420
Junior Member
- Jan 10, 2020
- 121
- 36
Using a virtual machine isn't the only way to do it, but it's an easier way to create unique browser fingerprints than dedicated software. If you think there's no need to separate cookies and browser fingerprints when logging into separate accounts I don't know what to tell you, but Instagram can definitely detect what you're doing if you manage your accounts by logging out and back in with the same browser/fingerprint.
rootjazz
Elite Member
- Dec 21, 2012
- 3,166
- 1,190
If you are referring to automating a browser, yes (and there is more you need to do that just use a VM and a proxy to hide the host machine if trying to automate 100s accounts
Manual Growth
BANNED - Failed to resolve a dispute
- Nov 18, 2020
- 3,771
- 806
Scrape usernames with all types of bios and separate or filter out accounts with a specific bio,This should work.