1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

For BHW - ezinearticle cats

Discussion in 'Cloaking and Content Generators' started by confined, Jan 9, 2009.

  1. confined

    confined Regular Member

    Joined:
    Jan 4, 2009
    Messages:
    216
    Likes Received:
    91
    Here's a list of categories for ezinearticles.com for PHP:

    Q: How do you use this?
    A: simply plug it into a PHP script and do something like:

    PHP:
    shuffle($cats); 
    // randomize array
    $url 'http://ezinearticles.com/?cat=' $cats[0]; 
    // first element of array
    $articlepage file_get_contents($url);
    //get article list for cat
    of course you would use CURL or something to fake user agent, interface and use a proxy but that's up to you. Next up you'd have to parse the list page to rip out each article.

    Now THE LIST: (a simple array, $cats)
    PHP:
    $cats = array('Business','Business:Accounting','Business:Accounting-Payroll','Business:Advertising','Business:Branding','Business:Career-Advice','Business:Careers-Employment','Business:Change-Management','Business:Consulting','Business:Continuity-Disaster-Recovery','Business:Customer-Service','Business:Entrepreneurialism','Business:Ethics','Business:Franchising','Business:Fundraising','Business:Human-Resources','Business:Industrial-Mechanical','Business:International-Business','Business:Job-Search-Techniques','Business:Management',
    'Business:Marketing','Business:Marketing-Direct','Business:Negotiation','Business:Networking','Business:Non-Profit','Business:Outsourcing','Business:PR','Business:Presentation','Business:Productivity','Business:Resumes-Cover-Letters','Business:Retail','Business:Sales','Business:Sales-Management','Business:Sales-Teleselling','Business:Sales-Training','Business:Security','Business:Small-Business','Business:Solo-Professionals','Business:Strategic-Planning','Business:Team-Building','Business:Top7-or-10-Tips','Business:Venture-Capital','Business:Workplace-Communication',
    'Business:Workplace-Safety','Internet-and-Businesses-Online','Internet-and-Businesses-Online:Affiliate-Revenue','Internet-and-Businesses-Online:Auctions','Internet-and-Businesses-Online:Audio-Streaming','Internet-and-Businesses-Online:Autoresponders','Internet-and-Businesses-Online:Banner-Advertising','Internet-and-Businesses-Online:Blogging','Internet-and-Businesses-Online:CMS','Internet-and-Businesses-Online:Domain-Names','Internet-and-Businesses-Online:E-Books','Internet-and-Businesses-Online:Ecommerce','Internet-and-Businesses-Online:Email-Marketing','Internet-and-Businesses-Online:Ezine-Publishing','Internet-and-Businesses-Online:Forums','Internet-and-Businesses-Online:Internet-Marketing','Internet-and-Businesses-Online:Link-Popularity','Internet-and-Businesses-Online:List-Building','Internet-and-Businesses-Online:PPC-Advertising','Internet-and-Businesses-Online:PPC-Publishing','Internet-and-Businesses-Online:Paid-Surveys','Internet-and-Businesses-Online:Podcasting','Internet-and-Businesses-Online:Product-Creation','Internet-and-Businesses-Online:Product-Launching','Internet-and-Businesses-Online:RSS','Internet-and-Businesses-Online:SEO','Internet-and-Businesses-Online:Search-Engine-Marketing',
    'Internet-and-Businesses-Online:Security','Internet-and-Businesses-Online:Site-Promotion','Internet-and-Businesses-Online:Social-Bookmarking','Internet-and-Businesses-Online:Social-Media','Internet-and-Businesses-Online:Social-Networking','Internet-and-Businesses-Online:Spam-Blocker','Internet-and-Businesses-Online:Traffic-Building','Internet-and-Businesses-Online:Video-Marketing','Internet-and-Businesses-Online:Video-Streaming',

    'Internet-and-Businesses-Online:Web-Design','Internet-and-Businesses-Online:Web-Development','Internet-and-Businesses-Online:Web-Hosting','Finance','Finance:Auto-Loans','Finance:Bankruptcy','Finance:Bankruptcy-Lawyers','Finance:Bankruptcy-Medical',
    'Finance:Bankruptcy-Personal','Finance:Bankruptcy-Tips-Advice','Finance:Budgeting','Finance:Commercial-Loans','Finance:Credit','Finance:Credit-Counseling','Finance:Credit-Tips','Finance:Currency-Trading','Finance:Debt-Consolidation','Finance:Debt-Management','Finance:Debt-Relief','Finance:Estate-Plan-Trusts','Finance:Home-Equity-Loans''Finance:Leases-Leasing','Finance:Loans','Finance:PayDay-Loans','Finance:Personal-Finance','Finance:Personal-Loans','Finance:Structured-Settlements','Finance:Student-Loans','Finance:Taxes','Finance:Taxes-Income','Finance:Taxes-Property','Finance:Taxes-Relief','Finance:Taxes-Tools','Finance:Unsecured-Loans','Finance:VA-Loans','Finance:Wealth-Building','Investing','Investing:Day-Trading','Investing:Futures-and-Commodities','Investing:IRA-401k','Investing:Mutual-Funds','Investing:Retirement-Planning','Investing:Stocks','Insurance','Insurance:Agents-Marketers','Insurance:Car-Auto','Insurance:Commercial','Insurance:Dental','Insurance:Disability','Insurance:Flood','Insurance:Health','Insurance:Home-Owners-Renters','Insurance:Life-Annuities','Insurance:Long-Term-Care','Insurance:Medical-Billing','Insurance:Personal-Property','Insurance:Pet','Insurance:RV-Motorcycle','Insurance:Supplemental','Insurance:Travel','Insurance:Umbrella','Insurance:Vision','Insurance:Watercraft','Insurance:Workers-Compensation','Legal','Legal:Copyright','Legal:Corporations-LLC','Legal:Criminal-Law','Legal:Cyber-Law','Legal:Elder-Law','Legal:Employment-Law','Legal:Identity-Theft','Legal:Immigration','Legal:Intellectual-Property','Legal:Labor-Law','Legal:Living-Will','Legal:Medical-Malpractice','Legal:National-State-Local','Legal:Patents','Legal:Personal-Injury','Legal:Real-Estate-Law','Legal:Regulatory-Compliance','Legal:Trademarks','Real-Estate','Real-Estate:Building-a-Home','Real-Estate:Buying','Real-Estate:Commercial-Construction','Real-Estate:Commercial-Property','Real-Estate:Condominiums','Real-Estate:FSBO','Real-Estate:Foreclosures','Real-Estate:Green-Real-Estate','Real-Estate:Home-Staging','Real-Estate:Homes','Real-Estate:Investing','Real-Estate:Land','Real-Estate:Leasing-Renting','Real-Estate:Marketing','Real-Estate:Mortgage-Refinance','Real-Estate:Moving-Relocating','Real-Estate:Property-Management','Real-Estate:Selling','Home-Based-Business','Home-Based-Business:Network-Marketing','Writing-and-Speaking','Writing-and-Speaking:Article-Marketing','Writing-and-Speaking:Book-Marketing','Writing-and-Speaking:Copywriting','Writing-and-Speaking:Public-Speaking','Writing-and-Speaking:Publishing','Writing-and-Speaking:Technical-Writing','Writing-and-Speaking:Teleseminars','Writing-and-Speaking:Writing','Writing-and-Speaking:Writing-Articles','Computers-and-Technology','Computers-and-Technology:Certification-Tests','Computers-and-Technology:Computer-Forensics','Computers-and-Technology:Data-Recovery','Computers-and-Technology:Hardware','Computers-and-Technology:Mobile-Computing','Computers-and-Technology:Personal-Tech'

    'Computers-and-Technology:Software','Gaming','Gaming:Communities','Gaming:Computer-Games','Gaming:Console-Games','Gaming:Console-Systems','Gaming:Online-Gaming','Gaming:Video-Game-Reviews','Communications','Communications:Broadband-Internet','Communications:Fax','Communications:GPS','Communications:Mobile-Cell-Phone','Communications:Mobile-Cell-Phone-Accessories','Communications:Mobile-Cell-Phone-Reviews','Communications:Mobile-Cell-Phone-SMS','Communications:Radio','Communications:Satellite-Radio','Communications:Satellite-TV','Communications:Telephone-Systems','Communications:VOIP','Communications:Video-Conferencing','News-and-Society','News-and-Society:Crime','News-and-Society:Economics','News-and-Society:Energy','News-and-Society:Environmental','News-and-Society:International','News-and-Society:Military','News-and-Society:Politics','News-and-Society:Pure-Opinion','News-and-Society:Religion','News-and-Society:Weather','Relationships','Relationships:Affairs','Relationships:Anniversaries','Relationships:Commitment','Relationships:Communication','Relationships:Conflict','Relationships:Dating','Relationships:Dating-for-Boomers','Relationships:Divorce','Relationships:Domestic-Violence','Relationships:Enhancement','Relationships:Friendship','Relationships:Gay-Lesbian','Relationships:Love','Relationships:Marriage','Relationships:Post-Divorce','Relationships:Readiness','Relationships:Sexuality','Relationships:Singles','Relationships:Wedding','Reference-and-Education','Reference-and-Education:Astronomy','Reference-and-Education:College-University','Reference-and-Education:Financial-Aid','Reference-and-Education:Future-Concepts','Reference-and-Education:Home-Schooling','Reference-and-Education:Languages','Reference-and-Education:Nature','Reference-and-Education:Online-Education','Reference-and-Education:Paranormal','Reference-and-Education:Psychic','Reference-and-Education:Psychology','Reference-and-Education:Science','Reference-and-Education:Survival-and-Emergency','Reference-and-Education:Vocational-Trade-Schools','Reference-and-Education:Wildlife','Health-and-Fitness','Health-and-Fitness:Acne','Health-and-Fitness:Aerobics-Cardio','Health-and-Fitness:Allergies','Health-and-Fitness:Alternative','Health-and-Fitness:Anti-Aging','Health-and-Fitness:Anxiety','Health-and-Fitness:Arthritis','Health-and-Fitness:Asthma','Health-and-Fitness:Autism','Health-and-Fitness:Back-Pain','Health-and-Fitness:Beauty','Health-and-Fitness:Build-Muscle','Health-and-Fitness:Childhood-Obesity-Prevention','Health-and-Fitness:Contraceptives-Birth-Control','Health-and-Fitness:Critical-Care','Health-and-Fitness:Dental-Care','Health-and-Fitness:Depression','Health-and-Fitness:Detoxification','Health-and-Fitness:Developmental-Disabilities','Health-and-Fitness:Diabetes','Health-and-Fitness:Disability','Health-and-Fitness:Diseases','Health-and-Fitness:Diseases-Multiple-Sclerosis','Health-and-Fitness:Diseases-STDs','Health-and-Fitness:Drug-Abuse','Health-and-Fitness:Ears-Hearing','Health-and-Fitness:Eating-Disorders','Health-and-Fitness:Emotional-Freedom-Technique','Health-and-Fitness:Environmental-Issues','Health-and-Fitness:Ergonomics''Health-and-Fitness:Exercise','Health-and-Fitness:Eyes-Vision','Health-and-Fitness:Fitness-Equipment','Health-and-Fitness:Hair-Loss','Health-and-Fitness:Hand-Wrist-Pain','Health-and-Fitness:Headaches-Migraines',

    'Health-and-Fitness:Healing-Arts','Health-and-Fitness:Healthcare-Systems','Health-and-Fitness:Heart-Disease','Health-and-Fitness:Home-Health-Care','Health-and-Fitness:Hypertension','Health-and-Fitness:Massage','Health-and-Fitness:Medicine','Health-and-Fitness:Meditation','Health-and-Fitness:Mens-Issues','Health-and-Fitness:Mental-Health','Health-and-Fitness:Mind-Body-Spirit','Health-and-Fitness:Mood-Disorders','Health-and-Fitness:Nutrition','Health-and-Fitness:Obesity','Health-and-Fitness:Pain-Management','Health-and-Fitness:Physical-Therapy','Health-and-Fitness:Popular-Diets','Health-and-Fitness:Quit-Smoking','Health-and-Fitness:Self-Hypnosis','Health-and-Fitness:Skin-Care','Health-and-Fitness:Sleep-Snoring','Health-and-Fitness:Speech-Pathology','Health-and-Fitness:Supplements','Health-and-Fitness:Thyroid','Health-and-Fitness:Weight-Loss','Health-and-Fitness:Womens-Issues','Health-and-Fitness:Yoga','Self-Improvement','Self-Improvement:Abundance-Prosperity','Self-Improvement:Achievement','Self-Improvement:Addictions','Self-Improvement:Affirmations','Self-Improvement:Anger-Management','Self-Improvement:Attraction','Self-Improvement:Coaching','Self-Improvement:Creativity','Self-Improvement:Empowerment','Self-Improvement:Goal-Setting','Self-Improvement:Grief-Loss','Self-Improvement:Happiness','Self-Improvement:Innovation','Self-Improvement:Inspirational','Self-Improvement:Leadership','Self-Improvement:Memory-Training','Self-Improvement:Mind-Development','Self-Improvement:Motivation','Self-Improvement:NLP-Hypnosis',

    'Self-Improvement:Organizing','Self-Improvement:Personal-Growth','Self-Improvement:Positive-Attitude','Self-Improvement:Self-Esteem','Self-Improvement:Speed-Reading','Self-Improvement:Spirituality','Self-Improvement:Stress-Management','Self-Improvement:Success','Self-Improvement:Techniques','Self-Improvement:Time-Management','Recreation-and-Sports','Recreation-and-Sports:Archery','Recreation-and-Sports:Auto-Racing','Recreation-and-Sports:Baseball','Recreation-and-Sports:Basketball','Recreation-and-Sports:Billiards','Recreation-and-Sports:Boating','Recreation-and-Sports:Bodybuilding','Recreation-and-Sports:Bowling','Recreation-and-Sports:Boxing','Recreation-and-Sports:Cheerleading','Recreation-and-Sports:Climbing','Recreation-and-Sports:Cricket','Recreation-and-Sports:Cycling','Recreation-and-Sports:Dancing','Recreation-and-Sports:Equestrian','Recreation-and-Sports:Extreme','Recreation-and-Sports:Fantasy-Sports','Recreation-and-Sports:Figure-Skating','Recreation-and-Sports:Fish-Ponds','Recreation-and-Sports:Fishing','Recreation-and-Sports:Football','Recreation-and-Sports:Golf','Recreation-and-Sports:Gymnastics','Recreation-and-Sports:Hockey','Recreation-and-Sports:Horse-Racing','Recreation-and-Sports:Hunting','Recreation-and-Sports:Martial-Arts','Recreation-and-Sports:Mountain-Biking','Recreation-and-Sports:Olympics','Recreation-and-Sports:Racquetball','Recreation-and-Sports:Rodeo','Recreation-and-Sports:Rugby','Recreation-and-Sports:Running','Recreation-and-Sports:Scuba-Diving','Recreation-and-Sports:Skateboarding','Recreation-and-Sports:Skiing''Recreation-and-Sports:Snowboarding','Recreation-and-Sports:Soccer','Recreation-and-Sports:Sports-Apparel','Recreation-and-Sports:Surfing','Recreation-and-Sports:Swimming','Recreation-and-Sports:Tennis','Recreation-and-Sports:Track-and-Field','Recreation-and-Sports:Triathlon','Recreation-and-Sports:Volleyball','Recreation-and-Sports:Wrestling','Travel-and-Leisure','Travel-and-Leisure:Adventure-Travel','Travel-and-Leisure:Airline-Travel','Travel-and-Leisure:Aviation-Airplanes','Travel-and-Leisure:Bed-Breakfast-Inns','Travel-and-Leisure:Budget-Travel','Travel-and-Leisure:Camping','Travel-and-Leisure:Car-Rentals','Travel-and-Leisure:Charter-Jets','Travel-and-Leisure:City-Guides-and-Information','Travel-and-Leisure:Cruise-Ship-Reviews','Travel-and-Leisure:Cruising','Travel-and-Leisure:Destination-Tips','Travel-and-Leisure:First-Time-Cruising','Travel-and-Leisure:Golf-Travel-and-Resorts','Travel-and-Leisure:Hotels-Accommodations','Travel-and-Leisure:Limo-Rentals-Limousines','Travel-and-Leisure:Luxury-Cruising','Travel-and-Leisure:Outdoors','Travel-and-Leisure:Pet-Friendly-Rentals','Travel-and-Leisure:Sailing','Travel-and-Leisure:Ski-Resorts','Travel-and-Leisure:Timeshare','Travel-and-Leisure:Vacation-Homes','Travel-and-Leisure:Vacation-Rentals','Home-Improvement','Home-Improvement:Appliances','Home-Improvement:Audio-Video','Home-Improvement:Bath-and-Shower','Home-Improvement:Cabinets','Home-Improvement:Cleaning-Tips-and-Tools','Home-Improvement:Concrete','Home-Improvement:DIY','Home-Improvement:Doors','Home-Improvement:Electrical','Home-Improvement:Energy-Efficiency','Home-Improvement:Feng-Shui','Home-Improvement:Flooring','Home-Improvement:Foundation','Home-Improvement:Furniture','Home-Improvement:Heating-and-Air-Conditioning','Home-Improvement:House-Plans','Home-Improvement:Interior-Design-and-Decorating',

    'Home-Improvement:Kitchen-Improvements','Home-Improvement:Landscaping-Outdoor-Decorating','Home-Improvement:Lighting','Home-Improvement:New-Construction','Home-Improvement:Painting','Home-Improvement:Patio-Deck','Home-Improvement:Pest-Control','Home-Improvement:Plumbing','Home-Improvement:Remodeling','Home-Improvement:Roofing','Home-Improvement:Security','Home-Improvement:Stone-Brick','Home-Improvement:Storage-Garage','Home-Improvement:Swimming-Pools-Spas','Home-Improvement:Tools-and-Equipment','Home-Improvement:Windows','Home-Improvement:Yard-Equipment','Home-and-Family','Home-and-Family:Babies-Toddler','Home-and-Family:Baby-Boomer','Home-and-Family:Crafts-Hobbies','Home-and-Family:Crafts-Supplies','Home-and-Family:Death-Dying','Home-and-Family:Elder-Care','Home-and-Family:Entertaining','Home-and-Family:Fatherhood','Home-and-Family:Gardening','Home-and-Family:Grandparenting','Home-and-Family:Holidays','Home-and-Family:Motherhood','Home-and-Family:Parenting','Home-and-Family:Parties','Home-and-Family:Pregnancy','Home-and-Family:Retirement','Home-and-Family:Scrapbooking','Pets','Pets:Birds','Pets:Cats','Pets:Dogs','Pets:Exotic','Pets:Farm-Ranch','Pets:Fish','Pets:Horses','Pets:Reptiles-Amphibians','Automotive','Automotive:ATV','Automotive:Mobile-Audio-Video''Automotive:Motorcycles','Automotive:RV','Automotive:Repairs','Automotive:Trucks','Cancer','Cancer:Breast-Cancer','Cancer:Colon-Rectal-Cancer','Cancer:Leukemia-Lymphoma-Cancer','Cancer:Lung-Mesothelioma-Asbestos','Cancer:Ovarian-Cervical-Uterine-Cancer','Cancer:Prostate-Cancer','Cancer:Skin-Cancer','Food-and-Drink','Food-and-Drink:Chocolate','Food-and-Drink:Coffee','Food-and-Drink:Cooking-Tips','Food-and-Drink:Crockpot-Recipes',

    'Food-and-Drink:Desserts','Food-and-Drink:Low-Calorie','Food-and-Drink:Main-Course','Food-and-Drink:Pasta-Dishes','Food-and-Drink:Recipes','Food-and-Drink:Restaurant-Reviews','Food-and-Drink:Salads','Food-and-Drink:Soups','Food-and-Drink:Tea','Food-and-Drink:Wine-Spirits','Womens-Interests','Womens-Interests:Cosmetic-Surgery','Womens-Interests:Menopause-HRT','Womens-Interests:Plus-Size','Arts-and-Entertainment','Arts-and-Entertainment:Animation','Arts-and-Entertainment:Astrology','Arts-and-Entertainment:Casino-Gambling','Arts-and-Entertainment:Humanities','Arts-and-Entertainment:Humor','Arts-and-Entertainment:Movies-TV','Arts-and-Entertainment:Music','Arts-and-Entertainment:Performing-Arts','Arts-and-Entertainment:Philosophy','Arts-and-Entertainment:Photography','Arts-and-Entertainment:Poetry','Arts-and-Entertainment:Tattoos','Arts-and-Entertainment:Visual-Graphic-Arts','Shopping-and-Product-Reviews','Shopping-and-Product-Reviews:Collectible-Jewelry','Shopping-and-Product-Reviews:Electronics','Shopping-and-Product-Reviews:Fashion-Style','Shopping-and-Product-Reviews:Gifts','Shopping-and-Product-Reviews:Internet-Marketing','Shopping-and-Product-Reviews:Jewelry-Diamonds','Shopping-and-Product-Reviews:Lingerie','Book-Reviews','Book-Reviews:Almanacs','Book-Reviews:Arts-Photography','Book-Reviews:Biographies-Memoirs','Book-Reviews:Biology','Book-Reviews:Business','Book-Reviews:Childrens-Books','Book-Reviews:Comics-Humor','Book-Reviews:Computers','Book-Reviews:Cookery-Cookbook','Book-Reviews:Current-Affairs','Book-Reviews:Dance','Book-Reviews:Economics','Book-Reviews:Educational-Science','Book-Reviews:Fiction','Book-Reviews:Health-Mind-Body','Book-Reviews:History','Book-Reviews:Home-Garden','Book-Reviews:Inspirational-Fiction','Book-Reviews:Internet','Book-Reviews:Internet-Marketing','Book-Reviews:Law-Legal','Book-Reviews:Lifestyle','Book-Reviews:Literary-Classics','Book-Reviews:Maps-Guides','Book-Reviews:Mens','Book-Reviews:Multicultural','Book-Reviews:Music','Book-Reviews:Mysteries-Thrillers','Book-Reviews:Non-Fiction','Book-Reviews:Personal-Finance','Book-Reviews:Pets','Book-Reviews:Philosophy','Book-Reviews:Physics','Book-Reviews:Poetry-Playscripts','Book-Reviews:Politics','Book-Reviews:Psychology','Book-Reviews:Reference-Encyclopedia-Dictionary','Book-Reviews:Romance','Book-Reviews:SciFi-Fantasy-Horror','Book-Reviews:Self-Help','Book-Reviews:Short-Stories','Book-Reviews:Spirituality-Religion','Book-Reviews:Sports-Literature','Book-Reviews:Travel-Leisure',

    'Book-Reviews:Wealth-Building','Book-Reviews:Weight-Loss-Diet','Book-Reviews:Westerns','Book-Reviews:Womens','Book-Reviews:Young-Adults');
     
    • Thanks Thanks x 8
  2. confined

    confined Regular Member

    Joined:
    Jan 4, 2009
    Messages:
    216
    Likes Received:
    91
    Fine if no one fucking appreciates it, here's how it's done:

    PHP:
    $findcats '@<a href="\/\?cat=([a-zA-Z0-9:\-]+)">([a-zA-Z0-9:\- ]+)<\/a>@is';
    $dat file_get_contents('http://ezinearticles.com');
    $dat substr($dat,strpos($dat,'<div id="cats">'));
    preg_match_all($findcats,$dat,$cats);
    $ucats $cats[1];
    echo 
    '$cats = array(';
    foreach(
    $ucats as $caT){
     echo 
    "'$caT',";
    }
    echo 
    ');';
    exit;
    of course this can be applied to other sites but you would have to alter the $findcats regular expression.

    OK who wants me to write a scraper for what site they don't have? I'll write one or two.
     
    • Thanks Thanks x 7
    Last edited: Jan 9, 2009
  3. Tcm9669

    Tcm9669 Regular Member

    Joined:
    Dec 30, 2007
    Messages:
    369
    Likes Received:
    26
    Thanks. I would love a scraper.

    Thanks button hit!
     
  4. confined

    confined Regular Member

    Joined:
    Jan 4, 2009
    Messages:
    216
    Likes Received:
    91
    Ok tell me a site you want scraped.. What sections, the format of output, etc.
     
  5. undeterminederror

    undeterminederror BANNED BANNED

    Joined:
    Mar 31, 2008
    Messages:
    630
    Likes Received:
    457
    please post here the codes of the scrapers. :D
     
  6. babypar

    babypar Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 19, 2007
    Messages:
    396
    Likes Received:
    89
    How about yell.com, scrape by category , get name, address, links, services
     
  7. jagrmeister721

    jagrmeister721 Junior Member

    Joined:
    Apr 3, 2008
    Messages:
    169
    Likes Received:
    28
    Occupation:
    Doing stuff I love which makes me money
    Location:
    San Francisco
    Thanks; this is very cool. Any thoughts of offering this as a service to those of us who are not programmers?
     
  8. undeterminederror

    undeterminederror BANNED BANNED

    Joined:
    Mar 31, 2008
    Messages:
    630
    Likes Received:
    457
    or to scrape aff for profiles, or another dating site ...
     
  9. Black_Hat_freak

    Black_Hat_freak Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 17, 2007
    Messages:
    181
    Likes Received:
    60
    The best thing would be a scraper plugin for wordpress (something which converts articles to posts)
     
  10. confined

    confined Regular Member

    Joined:
    Jan 4, 2009
    Messages:
    216
    Likes Received:
    91
    @Black_hat_freak: There isn't a plugin that scrapes ezinearticles and adds it as a post for wp already? There wp-o-matic, caffeinatedContent and some others but CC uses artic1esbase.c0m

    Ezinearticles limits how many times you can browse their site, so an automated tool would need lots of testing and tweaking.

    I would offer a service if there was a demand.

    @undetermined: an AFF profile scraper would be a good idea - if it doesn't exist already. Does it?


    everyone let me know the demand for specfiic sites to be scraped and I'd be glad to do it. some for free and some not. It will be fun
     
  11. undeterminederror

    undeterminederror BANNED BANNED

    Joined:
    Mar 31, 2008
    Messages:
    630
    Likes Received:
    457
    can you make a prophile scraper that downloads pics? and insert the description into the name of the pics:
    [description-scrapped].jpg
    ??? that would be owesome !!!
     
  12. undeterminederror

    undeterminederror BANNED BANNED

    Joined:
    Mar 31, 2008
    Messages:
    630
    Likes Received:
    457
    ...or if you can make a general profile scrapper. so as can modify the code to adapt for any dating/social site :d
     
  13. allfreetodo

    allfreetodo Registered Member

    Joined:
    Jan 9, 2008
    Messages:
    66
    Likes Received:
    16
    can you build a scrapper that can scrap the top 100 urls for any keyword?
     
  14. confined

    confined Regular Member

    Joined:
    Jan 4, 2009
    Messages:
    216
    Likes Received:
    91
    allfreetodo you mean it just scrapes a list of the top 100 urls or it scrapes each individual sites content?