[GET] My PHP Article Scraper & Spinner

Advertise on BHW
does the article spinner have any limit? Can I put 1000+ articles in there and spin?
 
When you select 10 articles, does it spin 10 articles together or just combines them into one big article?
 
isurfthenet said:
When you select 10 articles, does it spin 10 articles together or just combines them into one big article?
Click to expand...
it will select sentences from 10 articles randomly to create a new article (sentence level spin) and then spin phrases of the newly created article.
 
cbnoob said:
Here is another update guys. I've been testing it for a while and the spun articles are quite pretty.

Changes:
- New thesaurus, it will take a lot more time to generate articles but better uniqueness.
- Fixed some common errors in previous version
- Some simple yet useful modules
Code: 
http://www.multiupload.com/3F57G3QO98
cheers :D
Click to expand...

It's not working on my wamp install here cbnoob, appears to be a path problem...

Code: 
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP Warning:  include_once(c:\\wamp\\www\\php\\newsp\\library\\webbot\\LIB_parse.php) [<a href='function.include-once'>function.include-once</a>]: failed to open stream: No such file or directory in C:\\wamp\\www\\ocas\\class\\scrape-c.php on line 5, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP Stack trace:, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP   1. {main}() C:\\wamp\\www\\ocas\\index.php:0, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP   2. include_once() C:\\wamp\\www\\ocas\\index.php:10, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP   3. include_once() C:\\wamp\\www\\ocas\\class.php:9, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP Warning:  include_once() [<a href='function.include'>function.include</a>]: Failed opening 'c:\\wamp\\www\\php\\newsp\\library\\webbot\\LIB_parse.php' for inclusion (include_path='.;C:\\php\\pear') in C:\\wamp\\www\\ocas\\class\\scrape-c.php on line 5, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP Stack trace:, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP   1. {main}() C:\\wamp\\www\\ocas\\index.php:0, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP   2. include_once() C:\\wamp\\www\\ocas\\index.php:10, referer: http://localhost/ocas/index.php
[Tue Dec 27 14:09:47 2011] [error] [client 127.0.0.1] PHP   3. include_once() C:\\wamp\\www\\ocas\\class.php:9, referer: http://localhost/ocas/index.php
Do I need to add a path in my php.ini file or something? I don't have a /newsp/ folder.

Thanks

Tex
 
Ok my real problem causing me to not be able to grab articles was that in wamp I had to actually enable curl and restart the server, as per the tutorial below...

Code: 
http://joshuamcginnis.com/2008/09/16/how-to-enable-libcurl-in-wamp/
And then I went back through and turned off display_errors again in both the php.ini files mentioned in the tutorial above to hide the errors which hopefully soon will no longer be there, heh.

Anyone else having the display problems with all of the errors showing, but the script still working fine, should do the same. Open both php.ini files, just follow the general path shown in the tutorial as you may have a different version of wamp like I did, and do a search (Ctrl F) for display_errors (there will be two places it's at, find the one that says display_errors=on) and change it to display_errors=off and you'll once again have the nice clean interface it's designed to be.

Thanks cbnoob for the update!

*edit* Maybe this would be something to add to the FAQ cbnoob?

Tex
 
Last edited:
@texacola, I forgot to change some absolute paths. Fixed and reuploaded here:

Code: 
http://www.multiupload.com/C958QTW3LU
 
cbnoob said:
@texacola, I forgot to change some absolute paths. Fixed and reuploaded here:

Code: 
http://www.multiupload.com/C958QTW3LU
Click to expand...

Thanks for the quick fix, looks even better than ever.

The new (and exciting I might add!) Mass Generator...

1. doesn't say where the files are put after doing so like the other modules do, although I did find them in the newly created /www/ocas/mass/ folder
2. appears to only properly handle a single url even though the box is huge?

Any chance of adding the link spinner INTO the main Article Spinner as an option? Or else make a new section called something like Article Spinner With Links? And also make it able to handle multiple url's at the same time?

Also I get the following fatal error in googlescr.php when opening the page
Code: 
Fatal error: Cannot redeclare http_get() (previously declared in C:\wamp\www\ocas\class\botlib\LIB_http.php:118) in C:\wamp\www\ocas\library\webbot\LIB_http.php on line 121

And another in small.php when I hit the Start button
Code: 
Fatal error: Call to undefined function content_builder() in C:\wamp\www\ocas\small.php on line 62

I still love it even though it seems I'm nitpicking here.

Thanks again

Tex
 
Oh and because I have gone through and edited all the options in dropdowns so everything always says yes and so on, can you also say what gets changed when you fix this so I don't have to change those again please?

Thanks

Tex
 
Hey tex (and others),
Here are some short guidelines of the current modules and what they do:

1. Article Scraper (scraping articles) - OK
2. Article Spinner (spinning articles from selected directories) - OK
3. Mass Generator (mass generate articles and randomly includes your links in it), articles are generated and stored in mass folder. - OK
4. Single Spinner (Spin one article) Under development
5. Article Generator (generate article from spun article) - OK
6. Link maker (generate HTML code of link from ONE link and its anchor text) - OK
7. Mass Link Maker (Use this when you want to use same anchor for many links, acts like the Link maker) - OK
8. Google Content Scraper (Scrape content from top 20 of Google, stored in gscrape) Under development
8. Snippet Spinner (Generate a small block of spun text, good for bookmarking input) Under development
9. Video Spinner (scrape videos from Youtube based on user's keyword and spin them in {video1|video2|video3|video} - OK
10. Article Rewriter (Rewrite article by replacing the words/phrases with their thesaurus) Under development
 
texacola1 said:
Oh and because I have gone through and edited all the options in dropdowns so everything always says yes and so on, can you also say what gets changed when you fix this so I don't have to change those again please?

Thanks

Tex
Click to expand...
I don't get you here. Can you explain more?
texacola1 said:
Any chance of adding the link spinner INTO the main Article Spinner as an option? Or else make a new section called something like Article Spinner With Links? And also make it able to handle multiple url's at the same time?
Click to expand...

I'm looking into it. Thanks for your suggestion
 
best if you can allow api support for spinning solution like spinchimp, the best spinner and spinchief...
 
cbnoob said:
how can you put 1000+ articles anyway? It spins articles from directories
Click to expand...

I use get article pro for scraping articles and than save them in article folder of your spinner. Back to my question can it spin 1000+ articles thanks in advance!! Also could you explain how is paragraph spin working when sentance spin is enabled? Does it take paragraph from each article or does it just create multiple paragraph from various sentances.

older version creates longer articles.

Design is slightly off in explorer.(It was like this with all your versions)
 
Last edited:
juzfairy said:
best if you can allow api support for spinning solution like spinchimp, the best spinner and spinchief...
Click to expand...
A spinner that user other spinners's api? :D

Marcink99 said:
I use get article pro for scraping articles and than save them in article folder of your spinner. Back to my question can it spin 1000+ articles thanks in advance!! Also could you explain how is paragraph spin working when sentance spin is enabled? Does it take paragraph from each article or does it just create multiple paragraph from various sentances.

older version creates longer articles.

Design is slightly off in explorer.(It was like this with all your versions)
Click to expand...
Ah, in that case, yes. You can put 1000 articles in one folder and the script will generate the spun articles for you.

Here is how the spinner works:

It will built 3 types of paragraph (excluding the title):
- First paragraph
- Last paragraph
- Middle paragraph(s)

All paragraphs are built by selecting random sentences from the articles you supplies, however the first and the last sentence of each paragraph is actually the first and the last sentences of paragraphs in their articles so if you have articles that close in meaning, the spun articles will make sense.
The output paragraph at this phase will be like this:
{1st sentence 1|1st sentence 2|1st sentence 3}{2nd sentence 1|2nd sentence 2|2nd sentence 3}{3rd sentence 1|3rd sentence 2|3rd sentence 3}...

After building the first, last and few middle paragraphs, then will be combined as one article and it will be sent to spin formula to spin on phrases level.

Paragraph spun is a little different. Instead of building only one spun paragraph for each paragraph in the output article, it will built three so the spun article in this type of spin will be like:
{1st paragraph 1|1st paragraph 2}{1st paragraph 3}
...
{ending paragraph 1|ending paragraph 2}{ending paragraph 3}

So it will have more uniqueness.

Hope you can get it :D
 
Thank you it makes sence
older version creates longer articles.

Design is slightly off in explorer.(It was like this with all your versions)
 
Marcink99 said:
Thank you it makes sence
older version creates longer articles.

Design is slightly off in explorer.(It was like this with all your versions)
Click to expand...
I know, I try to create articles from 400 to 600 words. In the older version, you usually get 700+ words article, which is not accepted by some article directories and free blogs.
I know the issue with IE but it functions OK on all browsers. Use Firefox for the best appearance as I designed the layout in FF.
 
when i try to scrape from any article directory i dont get any results.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top