trevormorley
Regular Member
- Feb 25, 2010
- 250
- 88
anyone know of a scraper for yahoo voices, looking to rip some articles before it shuts at the end of the month..?
Yahoo voices scraper
- Thread starter trevormorley
- Start date
- Mar 10, 2010
- 42,697
- 107,138
I'm surprised it took this long to see a thread looking for a scraper for Yahoo Voices after that announcement the other day.
fatboy
Elite Member
- Aug 13, 2008
- 1,615
- 3,262
If anyone wants all the links to articles, grab them here - up to date as of about 10 minutes ago when the link grabber finished. Just writing the article grabber now.
All files are n the format <month>-<year>.txt
Might be handy if you know what keywords you want and they appear in the article title.
Code:
https://www.mediafire.com/?k74zuu4rmme61muAll files are n the format <month>-<year>.txt
Might be handy if you know what keywords you want and they appear in the article title.
Last edited:
ZennoBlaster
Senior Member
- Jan 17, 2014
- 1,047
- 324
If you're looking for a custom bot, let me know your budget.
Ming the Merciless
Power Member
- Sep 30, 2012
- 706
- 847
Does this mean that all articles on Yahoo Voices will be 100% (or near it) non-duplicate since Voices is closing? Like, scrape article and re-post it on your site before someone else does?
fatboy
Elite Member
- Aug 13, 2008
- 1,615
- 3,262
Ok - as I am in a good mood (although I will take any beers you want to throw at me!), here is a basic scraper. You will need the files I posted above. Select which files to use, what folder to save to and hit go - then walk away for a long time 
VT:
Download:
Not guaranteeing that this will work 100% but it will slip the articles which are video based - made this in about 20 minutes so may have bugs but I have a taxi coming to take me to the pub to watch the football!!
Like I said, hope it helps someone, if it does, mine is a beer please
*EDIT* Will keep an eye on this thread via the phone before the game starts and I go blind on beer. Won't be able to update anything but can answer questions if needed
VT:
Code:
https://www.virustotal.com/en/file/3a1798b8989bd12042b0fd05fa4d095ea655ee6de42a104d933c01a987ca2a86/analysis/1404587091/Download:
Code:
https://www.mediafire.com/?mq97920dl46a77wNot guaranteeing that this will work 100% but it will slip the articles which are video based - made this in about 20 minutes so may have bugs but I have a taxi coming to take me to the pub to watch the football!!
Like I said, hope it helps someone, if it does, mine is a beer please
*EDIT* Will keep an eye on this thread via the phone before the game starts and I go blind on beer. Won't be able to update anything but can answer questions if needed
Last edited:
TheUnborn
Elite Member
- Feb 21, 2013
- 3,534
- 1,856
Ok - as I am in a good mood (although I will take any beers you want to throw at me!), here is a basic scraper. You will need the files I posted above. Select which files to use, what folder to save to and hit go - then walk away for a long time
VT:
Code:https://www.virustotal.com/en/file/3a1798b8989bd12042b0fd05fa4d095ea655ee6de42a104d933c01a987ca2a86/analysis/1404587091/
Download:
Code:https://www.mediafire.com/?mq97920dl46a77w
Not guaranteeing that this will work 100% but it will slip the articles which are video based - made this in about 20 minutes so may have bugs but I have a taxi coming to take me to the pub to watch the football!!
Like I said, hope it helps someone, if it does, mine is a beer please
Thanks for sharing,will give it a try
fullyniche
BANNED
- Dec 17, 2013
- 6,358
- 2,178
Thanks for sharing.
+1 Vote from me.
+1 Vote from me.
Ok - as I am in a good mood (although I will take any beers you want to throw at me!), here is a basic scraper. You will need the files I posted above. Select which files to use, what folder to save to and hit go - then walk away for a long time
VT:
Code:https://www.virustotal.com/en/file/3a1798b8989bd12042b0fd05fa4d095ea655ee6de42a104d933c01a987ca2a86/analysis/1404587091/
Download:
Code:https://www.mediafire.com/?mq97920dl46a77w
Not guaranteeing that this will work 100% but it will slip the articles which are video based - made this in about 20 minutes so may have bugs but I have a taxi coming to take me to the pub to watch the football!!
Like I said, hope it helps someone, if it does, mine is a beer please
*EDIT* Will keep an eye on this thread via the phone before the game starts and I go blind on beer. Won't be able to update anything but can answer questions if needed
IMCapitalist
Senior Member
- Jan 21, 2014
- 1,088
- 60
search for some iMacros for Y voice scraping.
nabeelshams
Power Member
- Jan 23, 2012
- 595
- 143
Sorry for noobish question guys but do have to wait to untill these articles are deindexed from google? because if we dont, it will be plagiarism.
djw1606
Power Member
- Jan 24, 2014
- 654
- 390
Yep. Wait for them to be de-indexed and then load 'em on to your site.
