1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Good Scraper?

Discussion in 'Cloaking and Content Generators' started by blackhaze, Oct 28, 2008.

Tags:
  1. blackhaze

    blackhaze Power Member

    Joined:
    Jan 11, 2008
    Messages:
    661
    Likes Received:
    167
    Occupation:
    self made millionaire
    Location:
    in the matrix
    Home Page:
    Please recommend me a good scraping s/w, either Win or PHP.

    I have seen some amazing fake text generators and fake blog creators, but i think scraping based off interesting keywords and creating blogs based on the KW is a better way to go.

    My idea would be:

    Go to a certain site which lists keywords ---> grab keyword ---> scrape net for articles containing the keyword ---> dynamically create blog/static page.

    This should be possible in certain time intervals, eg. i set it to go to the site, check for a KW and scrape for KW and create articles/update my blog....like every 6 hours or so.

    I am sure something like this exists, someone point me to it please?

    G.
     
  2. dbrown

    dbrown Junior Member

    Joined:
    Dec 26, 2007
    Messages:
    104
    Likes Received:
    181
  3. blackhaze

    blackhaze Power Member

    Joined:
    Jan 11, 2008
    Messages:
    661
    Likes Received:
    167
    Occupation:
    self made millionaire
    Location:
    in the matrix
    Home Page:
    yes, its a content creator (a pretty good one actually), but i need a scraper which i myslf can use as i described. It should build dynamic sites, or at least fetch content according to certain keywords.

    One example would be google trends, get a keyword from there, and then fetch articles...
     
  4. cooooookies

    cooooookies Senior Member

    Joined:
    Oct 6, 2008
    Messages:
    1,008
    Likes Received:
    216
    Here you are:

    the well-known RSSGM, outdated and no longer supported

    and the free YACG (yet another content generator), which does pretty that what you want (content scraper, markov text; in the forum there are so many snippets for senseful extensions)

    But.. I tried it out and additionally bought unfortunately the YACGMI (mass installer)...

    for both products (yacg(mi)) holds:

    - bugs
    - waste of time ... you have to provide your own template AND additionally
    changes in the structure on file-system-level are highly recommended.
    yacgmi provides a more or less simple, but time-consuming way to 'quickly'
    make your own template
    - not for many pages intended
    - annoying caching mechanism (if u disable it, get a cup of coffee while rebuilding even a small site) ... if you make modifications to the wizards and change your template you will have many iterations to your final success
     
  5. blackhaze

    blackhaze Power Member

    Joined:
    Jan 11, 2008
    Messages:
    661
    Likes Received:
    167
    Occupation:
    self made millionaire
    Location:
    in the matrix
    Home Page:
    sorry, YAGC is a pain in the ***.

    If i want a landing page generator/content creator i certainly wont sit down for hours to hand-edit the templates.
    YACG comes "out of the box" with "google will ban you if you dont edit the standard templates" - and i am lazy and this is NOT what i expect from a site generator. Otherwise i could just start making sites from scratch, probably in the same time as it would take to make a decent template for YACG.
     
  6. Loak

    Loak Jr. VIP Jr. VIP

    Joined:
    Apr 21, 2008
    Messages:
    314
    Likes Received:
    109
    yacg is good if you know php, its one of the best but takes a lot of fucking around to get working.
     
  7. wedge421

    wedge421 Registered Member

    Joined:
    Aug 18, 2008
    Messages:
    99
    Likes Received:
    15
    You may actually want to higher a free lancer coder for this. A good coder can bang out one of these in like 30mins and it will do everything you need. And im sure the price will be right.
     
  8. blackhaze

    blackhaze Power Member

    Joined:
    Jan 11, 2008
    Messages:
    661
    Likes Received:
    167
    Occupation:
    self made millionaire
    Location:
    in the matrix
    Home Page:
    wedge, thats not the point. I can do HTML and PHP, so editing the templates would not be a problem. Its more the fact that its an annoying and time-consuming thing to do.

    Also, in the back of my head i had a content creator (i dont know which one it was, i could've sworn it was YACG in an earlier version...where it said they create pages without ANY footprints).


    So.it looks like you get a "automated content creator" (free, which is a good thing!) and you think...great..i can churn out pages quickly now. But in reality you have to sit down, get a hang of the syntax/variables and edit all the .php files til its actually usable.