Any facebook pages About Scraper ?

I have around 40k facebook pages adresses for a niche I am following.

Pages are like https://facebook.com/page-name/about

Each of these pages, have a website in Bio.

Any tool available to extract the urls from bio of all the 30k pages ?

THankyou!

gmc93 said:

I have around 40k facebook pages adresses for a niche I am following.

Pages are like https://facebook.com/page-name/about

Each of these pages, have a website in Bio.

Any tool available to extract the urls from bio of all the 30k pages ?

THankyou!

Click to expand...

For extracting website links from the /about section of 30k Facebook pages, a Python scraper using BeautifulSoup or Playwright (for JS-rendered content) can get the job done. Just make sure to throttle your requests and rotate your IPs to avoid blocks or rate limits. Mobile proxies are especially effective for this type of mass scraping, since they help mimic real-user behavior and bypass detection.

That's quite a collection of Facebook pages! Dealing with 40000 pages is definitely a large scale task. Extracting website URLs from each page's bio requires a tool robust enough to handle that volume. Unfortunately Facebook's API has limitations on bulk data extraction to prevent abuse. Scraping directly can be risky and may violate their terms of service. However some web scraping tools like Octoparse or ParseHub are designed for large scale extractions. You'd need to configure these tools to specifically target the "About" section of each page and extract the URL. Remember to check the extracted results. Some pages may not have a website listed or might contain other types of URLs. Before you start check Facebook's policies to ensure you're compliant. Good luck with your project!

too much pagess

You can try using PhantomBuster or Apify with a custom scraper. Just make sure your scraper targets the /about section and parses the website field. Rotate proxies if you're hitting a lot of pages to avoid blocks. Works like a charm if set up right.

Thanks all for the suggestions.

I tried the Zyte Api scraping with python but it seems not to extract the sites from bio for some reason.
I also tried a custom made python script with cookies from my browser..that didnt work also.
Tried Scrapebox for internal external with proxies..that didnt work
Tried few different scripts made by Grok and Chatgpt, with residential proxies that rotate on each request..there i had some links extracted but were looking like xx.facebook.com .. something like that looking... not even by far the correct urls.

The solution that I got it working but is very slow, its with BAS (BrowserAutomationStudio) ...

Will try the Octoparse as MickWilmer suggested and PhantomBuster as Brand Meteor said.... If anyone else have a suggestion for a tool or something already made that works, please write it here. Thankyou