Hi all,
I'm writing some crawler to get public FB profiles. First of all, is it legit to talk about this topic here? If not plz, say so and idealy redirect me to the correct place
The crawler is working fine, main problem is to get valid profiles to be used in the crawler. So im interested in 2 things:
1) Are there any well known criteria by which facebook assigns its "trust" to an account? Because some of my accounts are very "stable" where other are blocked within a few hundred profiles.... Or is this by chance?!
2) Are there any well known networking / request limits/strategies used to avoid blocking? I know there wont be a exact limit like 10 request per minute are ok, but I think here are people with a lot of experience in this fied, so... ?! Any "trusted" proxies?
Would be happy to find some people to talk about this and share some experiences.
I'm writing some crawler to get public FB profiles. First of all, is it legit to talk about this topic here? If not plz, say so and idealy redirect me to the correct place
The crawler is working fine, main problem is to get valid profiles to be used in the crawler. So im interested in 2 things:
1) Are there any well known criteria by which facebook assigns its "trust" to an account? Because some of my accounts are very "stable" where other are blocked within a few hundred profiles.... Or is this by chance?!
2) Are there any well known networking / request limits/strategies used to avoid blocking? I know there wont be a exact limit like 10 request per minute are ok, but I think here are people with a lot of experience in this fied, so... ?! Any "trusted" proxies?
Would be happy to find some people to talk about this and share some experiences.