[GET] Get Article - The Article Scraper

So ihow do you save in html?

Hope it works on ezine. :)

That's just something I tried on my debug version, will add it next week

This is really VERY useful already...thanks for sharing it with us.

In addition to the planned changes (title on first line of output, ability to specify # of articles to scrape per keyword), is it possible you can also add an option to output all articles to a single directory instead of the default of creating subdirectories? That would be really sweet.... :)

Sure, this will be quite easy to implement.
 
Getting some irrelevant results, not many... so can you add the option to add the ability for the keywords/phrase to be surrounded in quote marks please?



For example, "keyword 1 key word 2" and may be, also some thing like this: "keyword 1 key word 2" -UnwantedWord

Also, keywords surrounded by quote-marks isn't working at present...


Thanks! :)
 
This is a really great tool and with the addition of more directories its even better. Just a couple of small points:

1. Now that you have many more directories would it not be possible to have a drop down menu to select them. This would stop the main menu from getting too cluttered. Even give the user the option to add his own directory list.

2. I really like the way the keyword is used to create the subdirectory. It allows the user to segregate articles per project. Would it be possible to somehow add the article directory from where the article was scraped. Maybe in the file name or file iteself.

Anyway a great tool. Thanks:)

Luckyjim
 
Btw Can I edit your program for my own purposes, I have some grate Idea I would like to add into this tool?
 
awsome tool especially with the addition of the private proxy support. One of the best shares so far of 2011!
 
This is a useful tool for me as well. Thanks for sharing it!

I have only one suggestion:

Could you add a feature to start new paragraphs in new line when saving to text?

Thanks!
 
this looks good, would it be possible to add a built in spinner ?
to spin the text for the .txt files it makes,
only problem is most if not all spinners arent that good, and they usually change the keywords that the article is about,
i.e. if you have an article about "global warming" then it changes every "global warming" when you want that left the same.
 
this looks good, would it be possible to add a built in spinner ?
to spin the text for the .txt files it makes,
only problem is most if not all spinners arent that good, and they usually change the keywords that the article is about,
i.e. if you have an article about "global warming" then it changes every "global warming" when you want that left the same.

Check out TBS, with the bulk spin and protected keywords it does exactly what you are asking already. I know it's another program but it will do what you are asking and that way he can concentrate making this do what it does better than it already is.
 
whats TBS ?
do you mean the best spinner ?
so that scrapes articles frpm articles sites does it ?



Check out TBS, with the bulk spin and protected keywords it does exactly what you are asking already. I know it's another program but it will do what you are asking and that way he can concentrate making this do what it does better than it already is.
 
This is a useful tool for me as well. Thanks for sharing it!

I have only one suggestion:

Could you add a feature to start new paragraphs in new line when saving to text?

Thanks!

In the next version, there will be option to save to HTML, which will keep all formatting exactly as viewed from a browser
 
Now this is what i call a great share! Just what i was looking for. Thanks for giving this for free. Rep given.
 
I downloaded the 2nd version last night and it crashed on me twice about half way through the scraping process. The first version didn't do that. I'm running it on XP SP3. It did save what was scraped though so I got some articles.

Unfortunately I didn't write down the error message it gave me, next time I will and post it here.
 
I downloaded the 2nd version last night and it crashed on me twice about half way through the scraping process. The first version didn't do that. I'm running it on XP SP3. It did save what was scraped though so I got some articles.

Unfortunately I didn't write down the error message it gave me, next time I will and post it here.
Something like this? (see the attachment below)

The software continues to scrape articles so I just ignore this error.
 

Attachments

  • error.gif
    error.gif
    24.8 KB · Views: 87
Yep that's exactly it. But the software will close after I click on continue or quit.
 
very useful tool

can we get the title of articles saved to the txt file?
 
Back
Top