Anyone successfully scraped EzineArticles?

[trapmuzik]

I was going to do a scraper in php when I thought it might be easier to just use yahoo pipes. Well I tried using a pipe and EzineArticles basically blocked the scrape lol.. Here is what I got back after I tried to scrape:

You are browsing E*ineArticles*com faster than a normal human would.

You may be seeing this page for one of the following reasons:

• You have performed too many searches in a short period of time.
• You have requested too many pages in a short period of time.
• You have exceeded the daily allowable limit of page views.
• You have used a script or program to scrape content or keywords.

I didnt even know there was a daily limit on how many articles you could view. anyone else scrape from here?

 

[zozor]

Yeah. Never got that. Pm me your pipe so so I can fix it

 

[ddf1980]

Pm me your pipe so so I can fix it

lmfao..pause

 

[linuxgeek]

I've gotten errors like that while using wget. I usually just add a delay and change the user agent to one that looks like firefox or ie. I also add a proper referrer on some sites to keep from getting hotlink errors.

 

[hertz314]

I'm thinking about selling scraped ezine articles in packs. How much should I charge for 1000 articles?

 

[trapmuzik]

Yeah. Never got that. Pm me your pipe so so I can fix it

well i wasnt even finished with it yet. I was just checking the output so I could do the cut from part and ezine blocked me.. I will pm you what i have so far though

lmfao..pause

lol..

I've gotten errors like that while using wget. I usually just add a delay and change the user agent to one that looks like firefox or ie. I also add a proper referrer on some sites to keep from getting hotlink errors.

yea i was thinking i would just use php and add a delay to the scrape.. but yahoo just made it so much easier to setup.

 

[c0ntenth|ef]

maybe change the timer setting on your scraper if you can, i use everprofit toolbar for that.

 

[blackhat+er]

I was going to do a scraper in php when I thought it might be easier to just use yahoo pipes. Well I tried using a pipe and EzineArticles basically blocked the scrape lol.. Here is what I got back after I tried to scrape:

You are browsing E*ineArticles*com faster than a normal human would.

You may be seeing this page for one of the following reasons:

• You have performed too many searches in a short period of time.
• You have requested too many pages in a short period of time.
• You have exceeded the daily allowable limit of page views.
• You have used a script or program to scrape content or keywords.

I didnt even know there was a daily limit on how many articles you could view. anyone else scrape from here?

The last time I was using my scrapper I kept getting my ip banned.
I was only scrapping 10 articles per hour but for some reason kept bannin me so ive put that on ice and used other methods to get my content so please let me know what you use as a time delimiter.

I'm thinking about selling scraped ezine articles in packs. How much should I charge for 1000 articles?

Nice thread highjack you should kick yourself in the nuts

 

[kaene]

It's very difficult to scrap EzArticles, the only way is using a bunch of proxies and limiting the queries of each one. Another useful thing is to test first whether the articles are in google cache or similar sites, if isn't, then to go EzArticles, this way it will take longer to get banned.

 

[affdba1]

For a while I used their RSS feeds with Yahoo Pipes to get content to my autoblog, but something changed recently and the full feed module doesn't work anymore.
If you could solve the full feed module problem, the scrape would work again.

 

[matrik]

For a while I used their RSS feeds with Yahoo Pipes to get content to my autoblog, but something changed recently and the full feed module doesn't work anymore.
If you could solve the full feed module problem, the scrape would work again.

Yahoo pipes no longer works with Ezin*ear*ticles. They changed the robots.txt to block Yahoo Pipes user agent. Anyone interested can check the robots.txt. However, there are other ways to swiftly scrape'em.

 

[mtayyabrana]

Hey You talked about this scrapping, but I create one article and it is Approved and online Now

 

[bizhobby]

Not sure if this has been discussed already but just a crazy idea here...

What if... you... put as the agent 'GoogleBot' we all know sites OBEY Google and don't question it. Would that work?

 

[toptips44]

I just scrape from articlebase. Why not just use them instead ? They are much easier to scrape from as they don't care how many articles you grab.

 

[unbeatable]

I still cant do it, Ezine are quite smart, if anyone can do it, let us know!

 

[bwh48]

The easy way to scrape EZA is by using the same technique that WP-Robot uses.
They scrape their content from Bing & Yahoo.

Simple search Bing for the keyword you want, using the site:ezinearticles.com qualifier and then scrape the content from the cached page that is associated with each listing.

It easy, quick and you never, ever have to hit EZA to get their content..

Hope this helps someone..

B.

 

[bizhobby]

Can anyone offer the scraped content as an archive?

 

[srb888]

I used a method to scrape as many eza articles and as fast as my PC/net resources permitted without getting the message, and I used a Google search trick in combination (which unfortunately Google has now blocked), but I still wouldn't give the combo away as I fear that eza will quickly place specific blocks just like Google did.

 

[zelma143]

did you try curl with php?

 

[surferket]

I use Carty's Autoblogging Software to scrape a full feed thru ezine's own RSS feed.