Hey guys,
The past months I've been working on some web scraping projects with node and I am starting to build bots, at this point I need some input from the community.
Would you rather have a bot that uses the API?
ex:
instagram
[TABLE="width: 728"]
[TR]
[TH]ENDPOINT[/TH]
[TH]UNSIGNED CALLS (PER TOKEN)[/TH]
[TH]SIGNED CALLS (PER TOKEN)[/TH]
[/TR]
[TR]
[TD]POST /media/media-id/likes[/TD]
[TD]30 / hour[/TD]
[TD]100 / hour[/TD]
[/TR]
[TR]
[TD]POST /media/media-id/comments[/TD]
[TD]15 / hour[/TD]
[TD]60 / hour[/TD]
[/TR]
[TR]
[TD]POST /users/user-id/relationships[/TD]
[TD]20 / hour[/TD]
[TD]60 / hour[/TD]
[/TR]
[/TABLE]
Facebook
I've found 600 calls per 600 seconds, per token & per IP
Twitter
Rate limits in version 1.1 of the API are divided into 15 minute intervals, which is a change from the 60 minute blocks in version 1.0. Additionally, all 1.1 endpoints require authentication, so no longer will there be a concept of unauthenticated calls and rate limits
Having a bot that works with the API is way more safe of course but has a limit.
or would you like a headless browser that mimics the user movement (for the nerds: with phantomjs /zombiejs maybe) Still as many of you have discovered there is still a limit! (spam reduction)
My solution so far:
A hybrid bot that scrapes blackhat and follows/likes users with the API.
What would you guys like to see?
The past months I've been working on some web scraping projects with node and I am starting to build bots, at this point I need some input from the community.
Would you rather have a bot that uses the API?
ex:
[TABLE="width: 728"]
[TR]
[TH]ENDPOINT[/TH]
[TH]UNSIGNED CALLS (PER TOKEN)[/TH]
[TH]SIGNED CALLS (PER TOKEN)[/TH]
[/TR]
[TR]
[TD]POST /media/media-id/likes[/TD]
[TD]30 / hour[/TD]
[TD]100 / hour[/TD]
[/TR]
[TR]
[TD]POST /media/media-id/comments[/TD]
[TD]15 / hour[/TD]
[TD]60 / hour[/TD]
[/TR]
[TR]
[TD]POST /users/user-id/relationships[/TD]
[TD]20 / hour[/TD]
[TD]60 / hour[/TD]
[/TR]
[/TABLE]
I've found 600 calls per 600 seconds, per token & per IP
Rate limits in version 1.1 of the API are divided into 15 minute intervals, which is a change from the 60 minute blocks in version 1.0. Additionally, all 1.1 endpoints require authentication, so no longer will there be a concept of unauthenticated calls and rate limits
Having a bot that works with the API is way more safe of course but has a limit.
or would you like a headless browser that mimics the user movement (for the nerds: with phantomjs /zombiejs maybe) Still as many of you have discovered there is still a limit! (spam reduction)
My solution so far:
A hybrid bot that scrapes blackhat and follows/likes users with the API.
What would you guys like to see?