1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Check For Duplicate Content In Bulk

Discussion in 'Black Hat SEO' started by deeguy1, Mar 15, 2011.

  1. deeguy1

    deeguy1 Junior Member

    Joined:
    Mar 4, 2009
    Messages:
    197
    Likes Received:
    13
    Anyone know how I can check a batch of articles in text files to see if they've already been posted on the web? (duplicate content) Looking for a free solution preferably
     
  2. AdamMeds

    AdamMeds Newbie

    Joined:
    Nov 24, 2010
    Messages:
    16
    Likes Received:
    3
    Occupation:
    Affiliate Manager for MedsPartners
    Location:
    Cyprus
    Home Page:
    Check out Copyscape - if I understood you correctly, it should be exactly what you are looking for.
     
    • Thanks Thanks x 1
  3. deeguy1

    deeguy1 Junior Member

    Joined:
    Mar 4, 2009
    Messages:
    197
    Likes Received:
    13
    I'm aware of copyscpape, but is there a free or cheaper alternative that can compete with copyscape and check hundreds to thousands of pages or text files in bulk? I know copyscape isn't that expensive but I plan to check a very large amount of content
     
  4. theironlemming

    theironlemming Junior Member

    Joined:
    May 6, 2010
    Messages:
    148
    Likes Received:
    40
    Here's a free way to use copyscape. Might be a bit more tedious because youre checking 1,000s of pages, but it still can be done.

    Step 1) Sign up for a free blog (like blogger.com or even use your own), create a new page and copy / paste the content into that page.

    Step 2) Go to copyscape.com and paste the URL of your blog into the checker.

    Viola, free copyscape checking.
     
    • Thanks Thanks x 1
  5. partymarty4870

    partymarty4870 Elite Member

    Joined:
    Jul 7, 2010
    Messages:
    2,034
    Likes Received:
    1,690
    Location:
    I come from a land downunder
    Code:
    http://www.plagium.com/
    It checks strings of text rather than url's

    It's still one by one though
     
  6. andana

    andana Newbie

    Joined:
    Mar 15, 2010
    Messages:
    2
    Likes Received:
    1
    There are several such checkers:

    1. duplichecker

    2. plagium

    3. textbroker

    4. articlechecker

    5. plagiarisma

    They are all free... Some better than others but on the whole, you can get excellent results.

    I am sorry... I cannot post links
     
    • Thanks Thanks x 1
  7. britcpa

    britcpa Power Member

    Joined:
    Mar 25, 2010
    Messages:
    509
    Likes Received:
    1,384
    -----------------------------------------------

    best on that list are these 2 online tools, both FREE:
    HTML:
    http://plagium.com
    http://duplichecker.com/index.asp
    
    furthermore, create an alert to automatically warn you if/when another site is publishing YOUR content or attempting to scrape from you - another FREE service:
    HTML:
    http://www.copygator.com
    finally, these 2 products are FREE as well and operate off your own computer:


    HTML:
    http://www.dupefreepro.com 
    
    - similarity checker between versions of spun articles similar to functionality within spinnerchief
    HTML:
    http://www.textbroker.com/uncover/ 
    
    - highly customisable deplicate content checker that can run automated tasks as well as individual article checks
     
  8. britcpa

    britcpa Power Member

    Joined:
    Mar 25, 2010
    Messages:
    509
    Likes Received:
    1,384

    this FREE downloadable tool can be used to drill down into a site link-by-link, checking each page for plagiarism, but youre talking about checking articles before theyre uploaded arent you?

    Code:
    [URL]http://www.textbroker.com/uncover/[/URL] 
    
    - highly customisable duplicate content checker that can run 
    automated tasks as well as individual article checks
    
    if so, as mentioned by another poster earlier in the thread, load your content onto a free blog or a url of your own and where he's suggesting you put the address into copyscape, id suggest that you put it into this tool instead as you'll be able to analyse it more closely this way....

    watch the video @ textbrokers & it will explain more clearly....
     
    • Thanks Thanks x 1