Copy whole html Site?

[renateh]

Hi!

Does anyone know how to copy a whole webproject in html (including picture files and all pages!) that I can upload it to my own server?

Cheers

 

[a n o n y m o u s]

Check out HTTrack www.httrack.com

 

[ghettogong]

Yeah httrack is the best. Only if i could get rid of their recurring advertising lines in each file: "this file was copied by blablablblbq"
Posted via Mobile Device

 

[renateh]

Is there a version or comparable software with costs or any other ways to get rid of these ads?

 

[ruler0fall]

Yeah httrack is the best. Only if i could get rid of their recurring advertising lines in each file: "this file was copied by blablablblbq"
Posted via Mobile Device

That's only in the source.

You could check out wget, it has a mirror option.

 

[fatboy]

Have to agree with wget and the mirror options - hasn't failed yet!

 

[ruler0fall]

Have to agree with wget and the mirror options - hasn't failed yet!

It did when I tried mirroring forums.

 

[fatboy]

Really?
What switches did you give it and what forum software was it?

 

[AccuraX]

or... you could write your own script to do this using php pretty easily.. look into Curl

 

[ruler0fall]

Really?
What switches did you give it and what forum software was it?

Could get into this but it's off-topic so I wont.

Yes you could use PHP and curl, but why reinvent the wheel.

 

[DeadEyesOpened]

Website ripper copier, courtesy of your favorite torrent site.

 

[twmas52712]

i second wget. it will do everything you want.

 

[linkme]

Could get into this but it's off-topic so I wont.

Yes you could use PHP and curl, but why reinvent the wheel.

Couldnt agree more, esp. when wget is free and easy.

for those too lazy to type "wget --help | grep mirror", the easy flag for wget to mirror a site starting at the specified page and following all links is -m

Example:

wget -m hxxp://somesite.com/yourstartingpage.ext

FYI: -m is a shortcut for "-N -r -l inf --no-remove-listing"

you really should check out the included help for wget, then you can play with its aggressiveness etc.

 

[madblacker]

well, most sites just have one layout... so you just need to copy one page, you can't copy the server side code, anyways, you should look into how websites are made a bit more since what you're doing isn't really that complicated, if you need to copy javascript that would be more involved...

I guess if you're just coyping the whole site exactly as it is you would use the scripts, but if you want to put in your own content, you wouldn't need the entire site.

 

[GuerillaDreamer]

Can anyone recommend a resource for copying password protected forums? I've tried all the ones specified above and didn t see any fields for using logins.

If there is such a resource or if any of the above work please point it out.

Thanks,
GD

 

[Hyperion]

Don't know if you can also copy the CSS file otherwise those programs are quite useless these days.

 

[SmallPotatoes]

Can anyone recommend a resource for copying password protected forums? I've tried all the ones specified above and didn t see any fields for using logins.

Did you read the wget manual?

Log in on a "real" browser, save the site's session cookies to a file, pass that file to wget using the --load-cookies option, and presto, wget is logged in.

I have yet to encounter a site that wget can't snarf, except when there are areas reached only via Javascript/Flash links. But those areas won't get spidered by search engines anyway.

 

[macyzbor]

has anyone tried this method? is it successful ?

 

[ArthurDent42]

Hi!

Does anyone know how to copy a whole webproject in html (including picture files and all pages!) that I can upload it to my own server?

Cheers

I use wget.