1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[FREE] cScrape - vBulletin 3 & 4 RSS feed scraper & poster

Discussion in 'Black Hat SEO Tools' started by cripxo, Oct 11, 2011.

  1. cripxo

    cripxo Newbie

    Joined:
    Sep 20, 2011
    Messages:
    31
    Likes Received:
    14
    cScrape - vBulletin 3 & 4 RSS feed scraper & poster

    A BHW EXCLUSIVE.

    --------------------
    OVERVIEW
    --------------------

    One of the hardest things to do with a forum is get it going. The reality is, if you are trying to get a forum going and it currently has little to no members or threads/posts, the likelihood that your traffic will stick around, join, and post is very unlikely. This is where cScrape comes in. Basically, all cScrape does is allows you to add your own forum databases, RSS feeds to external forums, and it will scrape the threads and first page of replies within each link of the feed and use fake usernames as posters. It also comes with a built-in spinner that you can enable or disable if you want. This is best done with the cScrape cronjob scripts that you could run a couple times a day, or you can visit the cronjob scripts manually if you prefer.

    --------------------
    FEATURES
    --------------------

    Here the primary features of cScrape:

    - It will add X amount of fake users to your own forums
    - It will put X amount of those fake users on your forums "whos online" page via a seperate cronjob you can run every 15 minutes to keep active
    - It allows you to add an unlimited # of your own forums
    - It allows you to add an unlimited # of RSS feeds for external forums
    - It scrapes external forum RSS feeds and posts the threads/replies into your own forums
    - It uses fake usernames to post the scraped content into your own forums
    - It has a built-in title/message spinner that uses 1000 of the most popular english words, and spins them so it actually makes sense to read

    --------------------
    HOW IT WORKS
    --------------------

    Here is a basic rundown of how cScrape works:

    1. You add databases you have set up your own vb3 & vb4 forums on
    2. You add X amount of fake users to the databases, it has pre-defined fake usernames built in
    3. You add RSS feeds to external forums on the web, and link them to your own forums via the feed management page
    4. You set up a cron job or run the cron job script yourself by visiting it in your browser
    5. You customize your settings, depending on if you want the cronjobs turned on, titles & messages to be spun, etc

    It's really that simple.

    --------------------
    COMPATIBILITY
    --------------------

    The only forums you can currently scrape from must be a vBulletin 3 or 4, and must have RSS feeds. I have tested this to work with many different forums, and have found that only about 10% of them would not allow me to scrape them with cScrape. This is because they use heavily modified themes. cScrape not only works with vBulletin default themes, but a LOT of custom themes as well.

    --------------------
    REQUIREMENTS
    --------------------

    You need the following in order to run cScrape:

    - A web host, or WAMP installed on your computer
    - PHP 4+
    - MySQL 5+
    - Cronjobs (optional)
    - Your own copies of vBulletin installed on your server/computer (can be version 3 or 4)

    --------------------
    INSTALLATION
    --------------------

    Use the following steps to install cScrape and get it going:

    1. Import the "cscrape.sql" file into a new MySQL database you set up
    2. Edit the "inc-connect.php" file with the database host/username/password/name
    3. Upload all of the files within the "cScrape" folder to your web server (you can even run this with WAMP if you want)
    4. Visit the URL you installed cScrape on and log in with "admin" as the username, and "scrape2win" as the password
    5. CHANGE YOUR CSCRAPE USERNAME AND PASSWORD VIA THE SETTINGS PAGE
    6. Add databases you have installed vBulletin on
    7. Add fake users to those databases (this MUST be done or cScrape won't have users to use as posters of scraped content)
    8. Add RSS feeds to external vBulletin forums and link them to your own forum databases
    9. Run or set up the cronjob PHP files, whose URLs are found in the cron setup page.

    That's it. Initial installation should only take a few minutes, and adding your databases and fake users is really quick as well. I would say the longest part is adding RSS feeds, depending on how many you want to add.

    --------------------
    HOW TO GET IT
    --------------------

    I am offering the members of BHW this script for free in the hopes that you will help me improve my iTrader rating. You can use this with unlimited access, it is open source, and I will send you future 1.x updates for free. I also offer free tech support if you're having problems - just shoot me an email any time (my email is in the cScrape interface).

    Again, PLEASE give me a good iTrader rating if you like cScrape - that is all I'm asking for, and I spent months developing this script.

    Download cScrape here (since I'm having trouble attaching the ZIP file and I can't post URL's yet):

    2shared.com/file/vKmwEuFh/cScrape.html
     
    • Thanks Thanks x 12
  2. camo090

    camo090 Registered Member

    Joined:
    Nov 30, 2010
    Messages:
    67
    Likes Received:
    2
    What a wonderful Script! thanks very much! How can i add a + on your iTrade? i doon't know how it works.
     
  3. mic141414

    mic141414 Regular Member

    Joined:
    Jul 3, 2008
    Messages:
    344
    Likes Received:
    117
    Location:
    USA
    Home Page:
    thanks for that ... REALLY COOL
     
  4. cripxo

    cripxo Newbie

    Joined:
    Sep 20, 2011
    Messages:
    31
    Likes Received:
    14
    You're welcome :)

    Thanks for the iTrader
     
  5. cripxo

    cripxo Newbie

    Joined:
    Sep 20, 2011
    Messages:
    31
    Likes Received:
    14
    Go here: blackhatworld.com/blackhat-seo/itrader.php?u=223842
     
  6. Jeevs

    Jeevs Supreme Member

    Joined:
    Dec 14, 2010
    Messages:
    1,359
    Likes Received:
    1,628
    Let me Help out Wiz a bit ;)

    Hey buddy,thanks for the share..but you need to upload it on mediafire and attach a VT scan! VT scan is a MUST.Hope you understand.

    Jeevs

     
    Last edited: Oct 13, 2011
  7. cripxo

    cripxo Newbie

    Joined:
    Sep 20, 2011
    Messages:
    31
    Likes Received:
    14
    the zip only contains php, javascript, text and image files. its a php script, not executable software.
     
  8. Jeevs

    Jeevs Supreme Member

    Joined:
    Dec 14, 2010
    Messages:
    1,359
    Likes Received:
    1,628
    5 - If you are posting a download link for a file containing an PDF, an Executable Program File (EXE and MSI) or a script/template you must do the following:

    a) Scan the file FIRST at VirusTotal.Com and note the scan results.

    b) After the scan is completed, copy the URL of the scan results log and paste it in your new post, so that members
    who wish to download your file can go to that URL and view the scan log for themselves.
     
    • Thanks Thanks x 1
  9. missil3

    missil3 Newbie

    Joined:
    Oct 16, 2011
    Messages:
    33
    Likes Received:
    6
    thanks for making the script open source. Seems like a good script.

    I am trying to add an rss feed but it keeps saying : unable to scrape thread title

    Is there any special trick to getting rss feeds from the vbulletin forum
     
  10. dardany

    dardany Newbie

    Joined:
    Oct 21, 2011
    Messages:
    1
    Likes Received:
    0
    thank you very mach
     
  11. umaycool

    umaycool Newbie

    Joined:
    Jun 24, 2011
    Messages:
    16
    Likes Received:
    1
    why i can't download ,it show that url is broken.
     
  12. cripxo

    cripxo Newbie

    Joined:
    Sep 20, 2011
    Messages:
    31
    Likes Received:
    14
    when it says "unable to scrape thread title" it could be one of the following reasons:

    1. the RSS feed is empty (has no threads in it)
    2. the forum uses heavily modified themes so the regex/parser can't get the thread title from the page

    its working fine for me.
     
  13. beeHWfan

    beeHWfan Regular Member

    Joined:
    Aug 30, 2010
    Messages:
    452
    Likes Received:
    225
    Occupation:
    do it all
    Location:
    US
    Home Page:
    very nice, haven't had a chance to use it but thanks alot. I love custom scrapers. I have so many now I need to start using them lol. I have found you have to be careful, when I started my journey I was looking for anything and everyway to make money, now I am so busy with stuff that I don't have time to focus on my own sites. I have some projects to finish but after this I aint working for nobody else anymore just focus on my stuff.

    Anyway just felt like sharing I thanked and repped you thanks again. Peace.
     
  14. FallenAkatsuki

    FallenAkatsuki Newbie

    Joined:
    Oct 26, 2011
    Messages:
    9
    Likes Received:
    0
    nice release im trying this out when i got time
     
  15. freestuffspace

    freestuffspace Newbie

    Joined:
    Oct 26, 2011
    Messages:
    13
    Likes Received:
    0
    I like it...TY!!!!!!!!!!!!!!!!!!!!!!!!
     
  16. musicalflava

    musicalflava Newbie

    Joined:
    Jun 7, 2011
    Messages:
    43
    Likes Received:
    3
    can you use any RSS feeds, or has to be VB feeds ?

    ie how does it interpret the feed ? can we create our own custom feeds from other sources ?
     
  17. chifliiiii

    chifliiiii Newbie

    Joined:
    Dec 4, 2010
    Messages:
    2
    Likes Received:
    0
    Than cripxo i just gave you the itrader points, the scripts works great.

    I sent you a support email but i never got response anyway i figured myself


    Just check the html from the forum you trying to scrape.
    I was getting the same error so i edited the function scrape_vb4_thread ($s_url) in inc-functions.php to scrape the title correctly.

    Instead of using the title on the post i searched for the title on the thread like these:
    PHP:
    foreach($html->find('h1 > span') as $e
            {
                if (isset(
    $e->attr['class']) && preg_match('~threadtitle(.*?)~si'$e->attr['class']))
    Hope it helps
     
  18. TheMatrix

    TheMatrix BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    3,444
    Likes Received:
    7,279
    This is new. Never seen someone asking for iTrader in exchange of a download.. Hmm..
     
  19. charmol

    charmol Junior Member

    Joined:
    Oct 7, 2011
    Messages:
    173
    Likes Received:
    84
    Location:
    ~| TrOpiCaL PaRaDiSe |~
    I thought the iTrader system was for if you were involved in some kind of business transaction.

    It smells like someone is trying to build some fast rep to fleece some noobs. I may be wrong, but its definitely fishy.

    ~|ChaRoN|~
     
  20. TheMatrix

    TheMatrix BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    3,444
    Likes Received:
    7,279
    Yes, indeed! iTrader is to be given when some transaction takes place using the forum.