Copy whole html Site?

renateh

Regular Member
Joined
Nov 8, 2009
Messages
262
Reaction score
9
Hi!

Does anyone know how to copy a whole webproject in html (including picture files and all pages!) that I can upload it to my own server?

Cheers
 

ghettogong

Regular Member
Joined
Oct 7, 2009
Messages
299
Reaction score
28
Yeah httrack is the best. Only if i could get rid of their recurring advertising lines in each file: "this file was copied by blablablblbq"
Posted via Mobile Device
 

renateh

Regular Member
Joined
Nov 8, 2009
Messages
262
Reaction score
9
Is there a version or comparable software with costs or any other ways to get rid of these ads?
 

ruler0fall

Power Member
Joined
May 17, 2009
Messages
565
Reaction score
267
Yeah httrack is the best. Only if i could get rid of their recurring advertising lines in each file: "this file was copied by blablablblbq"
Posted via Mobile Device
That's only in the source.

You could check out wget, it has a mirror option.
 

fatboy

Elite Member
Joined
Aug 13, 2008
Messages
1,615
Reaction score
3,262
Have to agree with wget and the mirror options - hasn't failed yet!
 

fatboy

Elite Member
Joined
Aug 13, 2008
Messages
1,615
Reaction score
3,262
Really?
What switches did you give it and what forum software was it?
 

AccuraX

Newbie
Joined
Nov 13, 2009
Messages
33
Reaction score
0
or... you could write your own script to do this using php pretty easily.. look into Curl
 

linkme

Jr. VIP
Jr. VIP
Joined
Oct 26, 2009
Messages
422
Reaction score
137
Could get into this but it's off-topic so I wont.

Yes you could use PHP and curl, but why reinvent the wheel.

Couldnt agree more, esp. when wget is free and easy.

for those too lazy to type "wget --help | grep mirror", the easy flag for wget to mirror a site starting at the specified page and following all links is -m :)

Example:

wget -m hxxp://somesite.com/yourstartingpage.ext

FYI: -m is a shortcut for "-N -r -l inf --no-remove-listing"

you really should check out the included help for wget, then you can play with its aggressiveness etc.
 

madblacker

Regular Member
Joined
Nov 2, 2009
Messages
268
Reaction score
19
well, most sites just have one layout... so you just need to copy one page, you can't copy the server side code, anyways, you should look into how websites are made a bit more since what you're doing isn't really that complicated, if you need to copy javascript that would be more involved...

I guess if you're just coyping the whole site exactly as it is you would use the scripts, but if you want to put in your own content, you wouldn't need the entire site.
 

GuerillaDreamer

Registered Member
Joined
Jun 1, 2009
Messages
91
Reaction score
64
Can anyone recommend a resource for copying password protected forums? I've tried all the ones specified above and didn t see any fields for using logins.

If there is such a resource or if any of the above work please point it out.

Thanks,
GD
 

Hyperion

Regular Member
Joined
Apr 21, 2009
Messages
307
Reaction score
59
Don't know if you can also copy the CSS file otherwise those programs are quite useless these days.
 

SmallPotatoes

Newbie
Joined
Aug 22, 2009
Messages
8
Reaction score
0
Can anyone recommend a resource for copying password protected forums? I've tried all the ones specified above and didn t see any fields for using logins.
Did you read the wget manual?

Log in on a "real" browser, save the site's session cookies to a file, pass that file to wget using the --load-cookies option, and presto, wget is logged in.

I have yet to encounter a site that wget can't snarf, except when there are areas reached only via Javascript/Flash links. But those areas won't get spidered by search engines anyway.
 
Top