1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Copy whole html Site?

Discussion in 'Black Hat SEO Tools' started by renateh, Nov 21, 2009.

  1. renateh

    renateh Regular Member

    Joined:
    Nov 8, 2009
    Messages:
    262
    Likes Received:
    7
    Hi!

    Does anyone know how to copy a whole webproject in html (including picture files and all pages!) that I can upload it to my own server?

    Cheers
     
  2. a n o n y m o u s

    a n o n y m o u s Registered Member

    Joined:
    Sep 14, 2008
    Messages:
    78
    Likes Received:
    219
    • Thanks Thanks x 1
  3. ghettogong

    ghettogong Regular Member

    Joined:
    Oct 7, 2009
    Messages:
    299
    Likes Received:
    28
    Yeah httrack is the best. Only if i could get rid of their recurring advertising lines in each file: "this file was copied by blablablblbq"
    Posted via Mobile Device
     
    • Thanks Thanks x 1
  4. renateh

    renateh Regular Member

    Joined:
    Nov 8, 2009
    Messages:
    262
    Likes Received:
    7
    Is there a version or comparable software with costs or any other ways to get rid of these ads?
     
  5. ruler0fall

    ruler0fall Power Member

    Joined:
    May 17, 2009
    Messages:
    565
    Likes Received:
    263
    That's only in the source.

    You could check out wget, it has a mirror option.
     
  6. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,227
    Occupation:
    Retired
    Location:
    Old Peoples Home
    Have to agree with wget and the mirror options - hasn't failed yet!
     
  7. ruler0fall

    ruler0fall Power Member

    Joined:
    May 17, 2009
    Messages:
    565
    Likes Received:
    263
    It did when I tried mirroring forums.
     
  8. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,227
    Occupation:
    Retired
    Location:
    Old Peoples Home
    Really?
    What switches did you give it and what forum software was it?
     
  9. AccuraX

    AccuraX Newbie

    Joined:
    Nov 13, 2009
    Messages:
    33
    Likes Received:
    0
    or... you could write your own script to do this using php pretty easily.. look into Curl
     
  10. ruler0fall

    ruler0fall Power Member

    Joined:
    May 17, 2009
    Messages:
    565
    Likes Received:
    263
    Could get into this but it's off-topic so I wont.

    Yes you could use PHP and curl, but why reinvent the wheel.
     
  11. DeadEyesOpened

    DeadEyesOpened Junior Member

    Joined:
    May 24, 2008
    Messages:
    150
    Likes Received:
    69
    Location:
    Brisbane Australia
    Website ripper copier, courtesy of your favorite torrent site.
     
  12. twmas52712

    twmas52712 Junior Member

    Joined:
    Jun 17, 2009
    Messages:
    130
    Likes Received:
    27
    i second wget. it will do everything you want.
     
  13. linkme

    linkme Regular Member

    Joined:
    Oct 26, 2009
    Messages:
    422
    Likes Received:
    135
    Occupation:
    teh Internets (since 1998)
    Location:
    Online
    Couldnt agree more, esp. when wget is free and easy.

    for those too lazy to type "wget --help | grep mirror", the easy flag for wget to mirror a site starting at the specified page and following all links is -m :)

    Example:

    wget -m hxxp://somesite.com/yourstartingpage.ext

    FYI: -m is a shortcut for "-N -r -l inf --no-remove-listing"

    you really should check out the included help for wget, then you can play with its aggressiveness etc.
     
  14. madblacker

    madblacker Regular Member

    Joined:
    Nov 2, 2009
    Messages:
    268
    Likes Received:
    19
    well, most sites just have one layout... so you just need to copy one page, you can't copy the server side code, anyways, you should look into how websites are made a bit more since what you're doing isn't really that complicated, if you need to copy javascript that would be more involved...

    I guess if you're just coyping the whole site exactly as it is you would use the scripts, but if you want to put in your own content, you wouldn't need the entire site.
     
  15. GuerillaDreamer

    GuerillaDreamer Registered Member

    Joined:
    Jun 1, 2009
    Messages:
    91
    Likes Received:
    63
    Location:
    Inside the enemy lines
    Can anyone recommend a resource for copying password protected forums? I've tried all the ones specified above and didn t see any fields for using logins.

    If there is such a resource or if any of the above work please point it out.

    Thanks,
    GD
     
  16. Hyperion

    Hyperion Regular Member

    Joined:
    Apr 21, 2009
    Messages:
    307
    Likes Received:
    59
    Location:
    Treasure Island
    Don't know if you can also copy the CSS file otherwise those programs are quite useless these days.
     
  17. SmallPotatoes

    SmallPotatoes Newbie

    Joined:
    Aug 22, 2009
    Messages:
    8
    Likes Received:
    0
    Did you read the wget manual?

    Log in on a "real" browser, save the site's session cookies to a file, pass that file to wget using the --load-cookies option, and presto, wget is logged in.

    I have yet to encounter a site that wget can't snarf, except when there are areas reached only via Javascript/Flash links. But those areas won't get spidered by search engines anyway.
     
  18. macyzbor

    macyzbor Junior Member

    Joined:
    Jul 23, 2009
    Messages:
    147
    Likes Received:
    12
    Location:
    On the Sun
    has anyone tried this method? is it successful ?
     
  19. ArthurDent42

    ArthurDent42 Newbie

    Joined:
    Oct 29, 2009
    Messages:
    48
    Likes Received:
    8
    I use wget.