Socials scrapers on apify are failing

O

onlineseller20

Elite Member
Jr. VIP
Joined
Aug 8, 2022
Messages
2,910
Reaction score
585
I don't know if it's because result number is limited on free plan, or those socials scrapers have already been blocked by those big socials

no matter it's tiktok / threads / youtube / twitter... whatever

almost all of those scrapers can only deliver at most 100 results,

which I tried scraping with popular keywords that should be able to output tons of results
 
Last edited:
Advertise on BHW
i cannot speak for all the big social companies, obviously, but at least by appearance, due to the recent ai advancements and companies in the past few years and the ridiculous amount of scraping and even larger sudden competition of who owns this data has changed the landscape. previously, someone like meta could collect incredible amounts of data and sell it off to other companies, whereas now, it is happening to a lesser degree because many of these companies are in competition to have the biggest upperhand in the ai race and their own models. this is my perception of why many platforms have in the past year especially, limited their api to many outsiders which is why i believe you are seeing this issue
 
You are saying that when you scrape you are getting around 100 results per round? What do you mean by that? There are scaping services that allow you to scrape a large quantity depending on the extraction method so I just want to know what you mean.
 
ToyBox | IG Accounts said:
You are saying that when you scrape you are getting around 100 results per round? What do you mean by that? There are scaping services that allow you to scrape a large quantity depending on the extraction method so I just want to know what you mean.
Click to expand...
yes while scraping with popluar keywords eg dogs which should have brought lots of results,
there're only 100 results

maybe because I'm not logged in while scraping on apify
 
JohnSmithCPA said:
can you share which apify actors are not working with input example.
Click to expand...
too tired to list a lot , almost all
and search terms are generic like cats and dogs which should be able to have lots of results
 
At some point I was influenced to work with the apify for my social media marketing tool by their team with attractive credits offers. But then I decided to write my own code. Because at the end of the day you are still dependent on them and they can close your account anytime. Plus the customizability that my application required was not met by some of their API's.

When working with API's its always to write your own code and connect directly with the social network. It is a bit lengthy process but in the long run, its definitely worth it.
 
  • Like
Reactions: V
tousif1988 said:
At some point I was influenced to work with the apify for my social media marketing tool by their team with attractive credits offers. But then I decided to write my own code. Because at the end of the day you are still dependent on them and they can close your account anytime. Plus the customizability that my application required was not met by some of their API's.

When working with API's its always to write your own code and connect directly with the social network. It is a bit lengthy process but in the long run, its definitely worth it.
Click to expand...
This. I prefer coding my own solutions whenever I can, but if it's too time-consuming, I'd rather use an API.
 
V said:
This. I prefer coding my own solutions whenever I can, but if it's too time-consuming, I'd rather use an API.
Click to expand...
same here sometime you do not want to waste time and resource for testing it is good option you do not have to pay monthly as well.
 
  • Like
Reactions: V
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top