[GET] My PHP Article Scraper & Spinner

sam2oke · Jan 14, 2012

cool...awesome scripts...

thanks it's worked...

targata · Jan 14, 2012

UPDATE:

Wow this lil app rocks!

I solved my issues by
1-getting the latast version of the scraper (thanks and keep it up)
2- I heva 2 sip accounts and a softphone (voip) to which I re-assigned different ports to freeup port 80 for WAMP
3-Cleaned up my previous attemps rebooted and VOILA

Thanks OP's

maximviper · Jan 14, 2012

abbyknight24 said:
I am still getting an error message Fatal error: Call to undefined function curl_init() in C:wamp\www\spun\ocas\class\botlib\LIB_http.php on line 249
I removed the ; before the extension

Find "php_curl.dll"

Remove the semicolon before it. Save the file and restart WAMP.

still I cannot get it to work. aghhhhhhhhhhhhhhhhhh

Hey try this.

Step1)Click in wamp incon on the taskbar .
2) u will see a row "php"Hover your mouse over it.
3) U will see "php exensions" hover you mouse over it
4) U will see lots of php extension. on the second row there is PHP_CURL .
5)Enable it.
6)Restart wamp
7)Try running script again

I hope this will help

abbyknight24 · Jan 14, 2012

Yes! this worked thanks for your guide.

sourabhswarnkar said:
Hey try this.

Step1)Click in wamp incon on the taskbar .
2) u will see a row "php"Hover your mouse over it.
3) U will see "php exensions" hover you mouse over it
4) U will see lots of php extension. on the second row there is PHP_CURL .
5)Enable it.
6)Restart wamp
7)Try running script again

I hope this will help

maximviper · Jan 14, 2012

Hey cbnoob ,

I m using this version of your script:
http://www.mediafire.com/?wbs3slxrh1y6c6x

Found a little bug :
On page http://localhost/spin/googlescr.php

i get this error :

PHP:

Fatal error:  Cannot redeclare http_get() (previously declared in C:\wamp\www\spin\class\botlib\LIB_http.php:118) in C:\wamp\www\spin\library\webbot\LIB_http.php on line 121

Bcos of a simple bug.
You called
include_once('library/webbot/LIB_http.php');
include_once('library/webbot/LIB_parse.php');

Again on line 12,13 , But u included those files in class.php already.
So . i just deleted those two lines and now all seems fine.

----------
However i have a query. can you please explain how are u using such google custom search. I m very dumb i never came accross such way to search google

How to generate this kind of code

Code:

$url = 'http://www.google.com/custom?num='.$numofarti.'&hl=en&client=pub-3754405753000444&cof=FORID:10%3BAH:left%3BCX:EzineArticles%2520Top%2520Search%3BL:http://www.google.com/intl/en/images/logos/custom_search_logo_sm.gif%3BLH:30%3BLP:1%3BLC:%230000ff%3BVLC:%23663399%3BDIV:%23336699%3B&cx=partner-pub-3754405753000444:3ldnyrvij91&ad=w9&adkw=AELymgWEYVAEJiFoI_QbIJiuiFtPWIsq0CUDRBk2ojriJqQ4mvGj4JogyItjPzxDik4ilHAo_bSVKuK_Jg3GXrOcTJM-pwfCmEkaILXT6jsRaAgIYsoy4uc&channel=4551525989&boostcse=0&oe=ISO-8859-1&ei=T2F3ToK6HcueiAf60fG2DQ&q='.$query.'&start=0&sa=N';

cbnoob · Jan 15, 2012

sourabhswarnkar said:
Hey cbnoob ,

I m using this version of your script:
http://www.mediafire.com/?wbs3slxrh1y6c6x

Found a little bug :
On page http://localhost/spin/googlescr.php

i get this error :

PHP:

Fatal error: Cannot redeclare http_get() (previously declared in C:\wamp\www\spin\class\botlib\LIB_http.php:118) in C:\wamp\www\spin\library\webbot\LIB_http.php on line 121

Bcos of a simple bug.
You called
include_once('library/webbot/LIB_http.php');
include_once('library/webbot/LIB_parse.php');

Again on line 12,13 , But u included those files in class.php already.
So . i just deleted those two lines and now all seems fine.

----------
However i have a query. can you please explain how are u using such google custom search. I m very dumb i never came accross such way to search google

How to generate this kind of code

Code:

$url = 'http://www.google.com/custom?num='.$numofarti.'&hl=en&client=pub-3754405753000444&cof=FORID:10%3BAH:left%3BCX:EzineArticles%2520Top%2520Search%3BL:http://www.google.com/intl/en/images/logos/custom_search_logo_sm.gif%3BLH:30%3BLP:1%3BLC:%230000ff%3BVLC:%23663399%3BDIV:%23336699%3B&cx=partner-pub-3754405753000444:3ldnyrvij91&ad=w9&adkw=AELymgWEYVAEJiFoI_QbIJiuiFtPWIsq0CUDRBk2ojriJqQ4mvGj4JogyItjPzxDik4ilHAo_bSVKuK_Jg3GXrOcTJM-pwfCmEkaILXT6jsRaAgIYsoy4uc&channel=4551525989&boostcse=0&oe=ISO-8859-1&ei=T2F3ToK6HcueiAf60fG2DQ&q='.$query.'&start=0&sa=N';

Hi,

I've changed the library so as I said in previous post, there are some modules are working and some are under development.
About google search, you need to switch to the version that don't use https and turn off the instant as it uses ajax, it will show your keywords on the url. If you use the https and turn instant on, it would be hard (for me) to include the keyword and other variables in the query

theodor855 · Jan 15, 2012

Hey, thanks for sharing bro!

Im really interested in learning how to add another article directory. Im fine with the php but your custom google search query is weird. Can you please do a step by step guide how to add another directory?

Im interested in doing this because im swedish and im not really interested in english directories

!

relaxin · Jan 15, 2012

I was trying to pick your brain by going through your script, you seems to prefer preg_slipt() a lot instead of explode() even though you don't seem to use flags associated with preg_slipt(), why is that?. Don't you think it takes too much CPU especially the use of regex in content_builder($directo)?

Also I've noticed that when I use one of your large thesaurus file (925kb), content_builder($directo) can't go through the whole list, it selects few (even after I configured my php.ini file to use more than 1Gig of memory). In fact even when I use both 41kb and 86kb thesaurus I still get the same results, why is that?

cbnoob · Jan 15, 2012

theodor855 said:
Hey, thanks for sharing bro!

Im really interested in learning how to add another article directory. Im fine with the php but your custom google search query is weird. Can you please do a step by step guide how to add another directory?

Im interested in doing this because im swedish and im not really interested in english directories !

adding other directories is quite simple. You just go to the directory you want to scrape and enter a random keyword. Most directories use the GET method so you can see the structure of a query in the url. Replace the sample keyword with the $keyword variable so you can start scraping. You will need to parse the result page to get the search results also.

relaxin said:
I was trying to pick your brain by going through your script, you seems to prefer preg_slipt() a lot instead of explode() even though you don't seem to use flags associated with preg_slipt(), why is that?. Don't you think it takes too much CPU especially the use of regex in content_builder($directo)?

Also I've noticed that when I use one of your large thesaurus file (925kb), content_builder($directo) can't go through the whole list, it selects few (even after I configured my php.ini file to use more than 1Gig of memory). In fact even when I use both 41kb and 86kb thesaurus I still get the same results, why is that?

Actually, I built in script from my idea when I have very little knowledge of php (even now). I wrote, I got stuck, I googled and I pick the solutions from the search results so this script is not optimal.
About the thesaurus, you will not see big difference sometimes, or even more frequent that sometimes but the bigger has more synonyms than the smaller so it will cover wider range of articles. That's the way I assume. Surely, it will take a lot more time to complete as I tested (with dupefree pro), uniqueness is higher.

theodor855 · Jan 15, 2012

Been trying for a while to add another directory but don't get it to work

.

monsur · Jan 15, 2012

May I use it on windows 7?

cbnoob · Jan 15, 2012

monsur said:
May I use it on windows 7?

sure

toughtrasher · Jan 15, 2012

toughtrasher said:
What programs do you guys use this with?
I got it to work on my localhost and it's giving me regular spinnable content with the {} brackets and all.
What programs do you guys use to unravel that into regular human-readable content?

Ahem, guys. Please reply, I'd like to use this a lot. [:

AdsMakesSense · Jan 15, 2012

Thanks for sharing, this will come in handy, appreciate it!

cbnoob · Jan 16, 2012

toughtrasher said:
Ahem, guys. Please reply, I'd like to use this a lot. [:

The preview function in AMR, SEnuke can do this for you or use the article generator module in the script

twitproject · Jan 16, 2012

Two in one? great, it will save a lot of time...

toughtrasher · Jan 16, 2012

cbnoob said:
The preview function in AMR, SEnuke can do this for you or use the article generator module in the script

I don't have money for those weapons. ;[

cbnoob · Jan 16, 2012

toughtrasher said:
I don't have money for those weapons. ;[

You can get both for free. AMR has 5 days trial, Senuke has 15 days free and the article generator is free and included in the script

e128k · Jan 16, 2012

can definitely use this. thanks for sharing

toughtrasher · Jan 16, 2012

cbnoob said:
You can get both for free. AMR has 5 days trial, Senuke has 15 days free and the article generator is free and included in the script

Well, I'm looking to use this program as a long-term thing.

[GET] My PHP Article Scraper & Spinner

Newbie

Newbie

BANNED

Junior Member

BANNED

Senior Member

Newbie

Registered Member

Senior Member

Newbie

Junior Member

Senior Member

BANNED

Regular Member

Senior Member

Newbie

BANNED

Senior Member

Newbie

BANNED

Main Menu

Marketplace

Making Money

BlackHat World