HelloInsomnia
Elite Member
- Mar 1, 2009
- 1,801
- 3,042
Well that is the direction it's going. Of course people are going to want more automation... But I actually started this whole project off as a more automated thing. And I was scraping thousands of articles per day.
But the issue I ran into was accurate automated article extraction. I mean sure you can do the footprint thing. This is a Wordpress site and WP typically uses certain ids or tags or whatever. But when you're talking about so many websites over a long period of time I think that you need something other than that. Doing it that way seemed limiting and I realized that a lot of content was being missed. Content that other scrapers would probably miss as well.
Another issue was that social links, and other things would leak into the content, and so I found that I was doing a lot of manual checking of the articles anyway (well that and quality checking..)
I changed direction because despite the quantity of content I was able to get I still needed to check the quality and I was missing plenty of content. And yes you have to put a little work into looking at each page and determining if its something you want to keep.
Some of the goals I have for the software are to help you find better articles, and faster. And I have ideas about things such as article extraction, spun content, duplicate content and more.
Today there are early adopters, we have a lifetime license; that won't be a thing in the near future. I am working with customers and having long email conversations about what their ideas are and how they are already using the software for things I never even intended it to be used for (I mean its called Expired Article Searcher - I never thought it would be used for anything else..). So there is more to come. And the launch plans are going accordingly. We are in the early adopter phase as I mentioned. And probably early next year we will be ready for more of a mass adoption at which point this will probably become more well known.
I just want to say that this is not a support thread, so if anybody has support issues shoot me an email. I also don't check my PMs here ever. But I will try to come back soon and do it in case somebody needs help.
