superscraper
Newbie
- Apr 19, 2021
- 22
- 7
Is there a way to program, say, Scrapebox, to look for and grab only blog URL's that allow surfer links, say, a blog with a recent history of not too many, but recent blog posts/replies, that come from other people? I know not all blogs require registration, but fields like "post", "comment", "reply", etc. with text input or text area boxes are footprints to look for. Some use XML and I was told there are recaptcha or OCR scrapers. I was told some blogs are programmed on the backend, so unseen, as to whether they allow links, or say if there is a 15-post no-link minimum, you won't know their policy unless you look for certain patterns.