Socials scrapers on apify are failing

[onlineseller20]

I don't know if it's because result number is limited on free plan, or those socials scrapers have already been blocked by those big socials

no matter it's tiktok / threads / youtube / twitter... whatever

almost all of those scrapers can only deliver at most 100 results,

which I tried scraping with popular keywords that should be able to output tons of results

 

[bytegremlin]

i cannot speak for all the big social companies, obviously, but at least by appearance, due to the recent ai advancements and companies in the past few years and the ridiculous amount of scraping and even larger sudden competition of who owns this data has changed the landscape. previously, someone like meta could collect incredible amounts of data and sell it off to other companies, whereas now, it is happening to a lesser degree because many of these companies are in competition to have the biggest upperhand in the ai race and their own models. this is my perception of why many platforms have in the past year especially, limited their api to many outsiders which is why i believe you are seeing this issue

 

[ToyBox Marketing]

You are saying that when you scrape you are getting around 100 results per round? What do you mean by that? There are scaping services that allow you to scrape a large quantity depending on the extraction method so I just want to know what you mean.

 

[onlineseller20]

You are saying that when you scrape you are getting around 100 results per round? What do you mean by that? There are scaping services that allow you to scrape a large quantity depending on the extraction method so I just want to know what you mean.

yes while scraping with popluar keywords eg dogs which should have brought lots of results,
there're only 100 results

maybe because I'm not logged in while scraping on apify

 

[JohnSmithCPA]

can you share which apify actors are not working with input example.

 

[onlineseller20]

can you share which apify actors are not working with input example.

too tired to list a lot , almost all
and search terms are generic like cats and dogs which should be able to have lots of results

 

[JohnSmithCPA]

too tired to list a lot , almost all
and search terms are generic like cats and dogs which should be able to have lots of results

i ran test with yt scraper it worked without any issue. i am not the owner or anything. https://console.apify.com/view/runs/2cwxzPIBftQ7NoD2z

 

[onlineseller20]

i ran test with yt scraper it worked without any issue. i am not the owner or anything. https://console.apify.com/view/runs/2cwxzPIBftQ7NoD2z

this yt scraper works but a lot of others ig tk threads twitter... etc all aren't working

 

[tousif1988]

At some point I was influenced to work with the apify for my social media marketing tool by their team with attractive credits offers. But then I decided to write my own code. Because at the end of the day you are still dependent on them and they can close your account anytime. Plus the customizability that my application required was not met by some of their API's.

When working with API's its always to write your own code and connect directly with the social network. It is a bit lengthy process but in the long run, its definitely worth it.

 

[V]

At some point I was influenced to work with the apify for my social media marketing tool by their team with attractive credits offers. But then I decided to write my own code. Because at the end of the day you are still dependent on them and they can close your account anytime. Plus the customizability that my application required was not met by some of their API's.

When working with API's its always to write your own code and connect directly with the social network. It is a bit lengthy process but in the long run, its definitely worth it.

This. I prefer coding my own solutions whenever I can, but if it's too time-consuming, I'd rather use an API.

 

[JohnSmithCPA]

This. I prefer coding my own solutions whenever I can, but if it's too time-consuming, I'd rather use an API.

same here sometime you do not want to waste time and resource for testing it is good option you do not have to pay monthly as well.