Scrape JavaScript Rendered Dynamic Content From Any Website (Bonus: Scrape the Dark Web + Make Screenshots of Websites) |HeadlessBrowserAPI

Status
Not open for further replies.

WPAutoGuy

Power Member
Jr. VIP
Joined
Feb 20, 2018
Messages
534
Reaction score
441
Welcome,
Web scraping can make anyone sweat.
Welcome to Climate Control!
Check the most comprehensive and powerful web scraping solution yet invented. Cloud-based.

g8YUxh2



So, what makes people who try web scraping sweat? Here are some quotes from them:
- My web scraping tools still don't run JavaScript
- I have to set up a complex infrastructure for just one little program
- We were just blocked by another site
- The site I have to scrape just changed, again…
- …and the invalid data had already been sent to our users



With HeadlessBrowserAPI you get:
- Use any of the 3 different headless browsers built into the API: Puppeteer, PhantomJS or Tor
- A fully-functional JavaScript and jQuery rendering headless browser
- Ability to scrape the Dark Web (any available .onion site), using the API's Tor endpoint
- The ability to use your own proxies for scraping
- An entirely cloud-based solution
- A significantly simplified approach to building web scraping applications
- Major improvements in resulting data reliability and robustness
- Dramatic increases in web scraping efficiency
- Ability to create full width and height screenshots of web pages in no time


How to use the API:
- If you want to get started with scraping instantly, no problem, the API is already built into the following WordPress plugins: Crawlomatic, Echo RSS or Newsomatic
- Or, alternatively, you can also develop your own scraping tool using this API, check its documentation page for help with this


Video showing API functionality:


Subscription plans:
- Headless Hatchling: 100 API requests/day - 15$/month
- Headless Scraper: 250 API requests/day - 30$/month
- Headless Enthusiast: 500 API requests/day - 50$/month
If you need more API calls, please contact me -> [email protected]



Contact:
Email Support / Pre-Sale Questions:

https://headlessbrowserapi.com/contact/
[email protected]


Supported payment gateway:
PayPal


Refund policy:
Because of the nature of this service, I cannot offer refunds for the API subscription, however, you can cancel your subscription any time.
If you have issues with the API, feel free to contact me and I will help fix the issues you encountered.


FAQ:
Q: What is HeadlessBrowserAPI and how does it work?

HeadlessBrowserAPI is a sast, scalable and reliable web scraper API with limitless potential. It uses headless browsers like Puppeteer, PhantomJS or Tor to scrape sites for you in no time and to also render the dynamic content from them (the JavaScript generated content, which is not visible to conventional scrapers).

Q: Is it beginner friendly?
Sure, it is easy to set up and configure. Check the API's documentation page for details. If you don't want to mess with code or directly with the API and if you like WordPress, the API is already built into the following WordPress plugins which will do the hard lifting for you in your web scraping jobs: Crawlomatic, Echo RSS or Newsomatic

Q: What if I need more API requests per day?
In this case, feel free to contact me at [email protected] and I can provide a customized plan to fit your needs.

Q: Am I able to create full size screenshots of web pages using this API?
Yes, just call its specialized API endpoint which creates screenshots, and you will get the screenshot image in jpg format, directly in the API response.

Q: Can this API really access the Dark Web and scrape any onion site from it?
Yes, if the site is available on the Dark Web and you know its .onion address, you can use this API to access its contents and to scrape it.

Q: Do you offer discounts or coupons?
Currently I cannot offer discounts or coupons, the price of the API is straight forward, no hidden fees and includes full access to the service. If the API will have promotional periods in the future, they will be announced accordingly.

Q: Will the price stay the same forever?
Not at all! I constantly work on the API adding new features to it. Its price will probably increase with each major update it gets.

Q: I need a refund, what should I do?
Currently I cannot process refunds for the API subscriptions, however, feel free to cancel your subscription any time, without extra costs.

Q: Can I freely cancel my subscription?
Yes, you can cancel your subscription at any time in your PayPal subscriptions dashboard or by contacting support, you will not be charged for cancelling.

Q: Can I check my used request volume?
This feature is not yet available, but I am working on a method to make used API call count transparent in the API requests.


Still curious and want to know more details?
Start web scraping today, click the link from below!

>> Visit Now <<
https://headlessbrowserapi.com/
 
Marketplace Thread Approved
Summary
This service has been tested by the marketplace moderation team to ensure that it meets the standards for the marketplace. The service has been checked to ensure that it can deliver what it advertised in accordance with its TAT or in a timely manner if no TAT was provided.
Service Information
  • The Scraper works as expected
  • The API request returns a JSON with all the HTML data for any query we tested
  • Within the JSON response, you can find a key called "apicalls" with a value that corresponds to the remaining requests you have
  • We also test it in WordPress and it works as advertised
Thread Edit Log
  • The 5 most recent thread edits will appear here
With anything more than 5 going in here
Information For Buyers:
  • Service Quality: The quality of the product or service that I receive is what you should expect, or better. If you feel that the quality of the service has dropped significantly, please let us know via the report button.
  • Disputes: If you do not receive a product or service as advertised, or at all in the event of a dispute, do not be afraid of a "no refunds" refund policy as you are allowed to request a refund through the shit list process. For more information and to see whether or not your dispute qualifies, refer to the shit list rules and procedures.
  • Review Copies: Per the marketplace rules, if a seller does not offer trials or review copies, please do not request them in the sales thread, otherwise your post will be removed and further action may be taken.
 
Does this only do screenshots or can it use all of Puppeteer's API calls?
The API can make screenshots and also scrape the HTML content of pages, with JavaScript rendered dynamic content available in the response.

It can also use Puppeteer, PhantomJS to scrape pages and even Tor to scrape sites from the Dark Web.

If you have suggestions of more features for the API, i am open to hear them. :)

Cheers!
 
The HeadlessBrowserAPI was recently updated, it now can also inject your own JavaScript code into scraped websites, allowing you to modify the sites in any way imaginable.
Also, you can now set localstorage objects (which are similar to cookies, but are not sent to the server, just kept on the client). Some modern sites use these to remove popups and annoying messages.
The screenshot feature was also updated, now you can also set the desired screenshot size of the pages (until now, only full page screenshots were supported).

Cheers!
 
If you have ideas for new features for this API, let me know. Interested in hearing your thoughts on what features would you like to see in it.
Cheers!
 
Hey guys,

Many updates landed to the HeadlessBrowserAPI today: automatic CAPTCHA solving, adblocking and better stealth mechanisms to not be detected as a robot while scraping websites.
Also, a while ago, built-in rotating proxy support was also added to the API (this was not mentioned here yet).

Cheers!
 
Currently working on more features for this API. Updates will come soon.
 
Just a heads up, added the ability to the scraper to also click on content links and scraping the result, details in the video below:
 
This thread has been closed as the member is no longer active on BHW or has decided not to renew their service.

If this is your thread and you'd like to renew, please see the "Closure and re-opening requests" section of the Marketplace rules for more information on how you can do this.
 
Status
Not open for further replies.
Back
Top